-- Logs begin at Mon 2022-07-25 18:00:25 UTC, end at Mon 2022-07-25 19:34:56 UTC. -- Jul 25 19:04:57.058813 dv-osbrick-786732-10-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 25 19:04:57.069309 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jul 25 19:04:57 2022] *** Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: nodename: dv-osbrick-786732-10-ceph Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: machine: x86_64 Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: clock source: unix Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: pcre jit disabled Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: detected number of CPU cores: 4 Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: current working directory: / Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: detected binary path: /usr/bin/uwsgi-core Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: your processes number limit is 47680 Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: your memory page size is 4096 bytes Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: detected max file descriptor number: 2048 Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: lock engine: pthread robust mutexes Jul 25 19:04:57.072152 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: thunder lock: enabled Jul 25 19:04:57.082144 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 25 19:04:57.082144 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 25 19:04:57.120602 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: Python main interpreter initialized at 0x55b71f5de9c0 Jul 25 19:04:57.120602 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: python threads support enabled Jul 25 19:04:57.120602 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: your server socket listen backlog is limited to 100 connections Jul 25 19:04:57.120602 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: your mercy for graceful operations on workers is 90 seconds Jul 25 19:04:57.121025 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: mapped 403077 bytes (393 KB) for 2 cores Jul 25 19:04:57.121025 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: *** Operational MODE: preforking *** Jul 25 19:04:57.121317 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: *** uWSGI is running in multiple interpreter mode *** Jul 25 19:04:57.121317 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: spawned uWSGI master process (pid: 87465) Jul 25 19:04:57.121535 dv-osbrick-786732-10-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 25 19:04:57.122675 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: spawned uWSGI worker 1 (pid: 87474, cores: 1) Jul 25 19:04:57.122675 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: spawned uWSGI worker 2 (pid: 87475, cores: 1) Jul 25 19:04:57.122675 dv-osbrick-786732-10-ceph devstack@keystone.service[87465]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 25 19:05:02.997690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:05:02.997690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: from cryptography.utils import int_from_bytes Jul 25 19:05:02.998514 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:05:02.998514 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: from cryptography.utils import int_from_bytes Jul 25 19:05:03.020832 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:05:03.020832 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: from cryptography.utils import int_from_bytes Jul 25 19:05:03.021506 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 25 19:05:03.021506 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: from cryptography.utils import int_from_bytes Jul 25 19:05:03.053306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:05:03.053531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:05:03.053668 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] command line args: [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:05:03.053927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:05:03.054106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ================================================================================ {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:05:03.054365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] admin_token = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.054611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] config_dir = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.054825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.054959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] config_source = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.055187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] debug = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.055431 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.056928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.056928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.056928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.056928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.056928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.057685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_config_append = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.057685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.057685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_dir = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.057685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_file = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.058100 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.058100 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.058324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.058534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.058722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.058892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.059139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.059428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.059648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.059939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.060175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.060419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.060665 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.060900 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.061187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.061685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.112/identity {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.061890 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] publish_errors = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.062086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.062320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.062499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.062746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.062979 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.063216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] standard_threads = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.063488 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.063724 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.063916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.064084 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] use_journal = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.064249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] use_json = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.064424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] use_stderr = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.064598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] use_syslog = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.064832 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.065093 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.065335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.065593 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.065834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.066086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.066324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.066571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.066808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.067055 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.067302 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.067577 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.067812 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.068069 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.068304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.068543 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.068790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.069028 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.069282 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.069533 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.069777 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.070012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.070266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.070527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.070879 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.071133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.071367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.071682 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.071809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 25 19:05:03.071954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.072083 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 25 19:05:03.072237 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.072367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] command line args: [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 25 19:05:03.072487 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.072614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 25 19:05:03.072745 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.072874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ================================================================================ {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 25 19:05:03.073071 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.073198 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] admin_token = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.073319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.073442 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] config_dir = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.073560 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.073674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.073674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] config_source = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.073905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.074028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] debug = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.074154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.074274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.074441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.074566 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.074696 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.074825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.074996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.076447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.076657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.076793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.076899 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.077027 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.077122 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.077192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_config_append = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.077192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.077316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.077374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_dir = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.077437 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.077546 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_file = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.077632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.077750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.077896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.078372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.078460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.078523 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.078639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.078765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.078868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.078983 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.079064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.079178 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.079334 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.079495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.079612 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.079689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.079892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.080056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.080178 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.080254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.080321 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.080422 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.080507 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.080634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.080712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.080778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.080879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.080991 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.080991 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.081163 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.081249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.081249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.081368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.112/identity {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.081428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.081554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] publish_errors = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.081639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.081713 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.081828 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.081903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082030 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.082107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.082250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.082445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.082607 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] standard_threads = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.082793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.082946 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.082946 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.083087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.083159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] use_journal = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.083229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.083299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] use_json = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.083299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] use_stderr = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.083577 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.083664 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] use_syslog = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.083738 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.083738 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.083866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 25 19:05:03.083937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084158 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084235 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084306 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084376 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084455 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084619 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084713 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.084935 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085090 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085328 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085416 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085589 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.085920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086162 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086311 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086642 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.086869 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087138 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087745 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087839 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.087977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088060 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088445 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088731 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.088956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089522 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089637 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.089977 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090373 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.external = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.090993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091525 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.password = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091681 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] auth.token = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.091919 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092045 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092153 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092564 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.092935 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.093979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094105 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094422 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094672 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.094891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095158 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095452 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.095980 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096233 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096682 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.096929 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097509 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097661 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097741 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.097990 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098302 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098610 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098753 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.098857 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099093 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099864 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.099942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.100912 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101396 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101545 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101625 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.101871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102020 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102338 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102585 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.102965 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.103946 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104029 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.104967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105207 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105524 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.105914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106147 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106415 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106704 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.106883 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107021 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107233 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107309 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107442 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.107911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108054 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108769 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.108993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109240 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109624 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109705 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.109942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.external = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110111 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110350 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110423 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110574 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.110913 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.password = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111158 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] auth.token = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.111884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112014 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112132 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112273 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112620 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.112894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113120 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113309 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113857 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.113934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114307 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114397 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.114847 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115246 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115563 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.115952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116318 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116624 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.116936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.117016 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.117272 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.117402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.117558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.117689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.117873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118502 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.118945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119337 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.119982 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120111 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120688 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120838 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.120944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121183 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.121887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122126 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122423 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122557 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122663 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.122909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123518 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.123942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124046 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124287 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124395 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124537 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124775 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.124881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125122 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] role.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] role.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125618 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.125979 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126214 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126302 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126457 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.126932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127020 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127178 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127523 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.127920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128001 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128166 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128244 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128413 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128500 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.128995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.129948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130190 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130322 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130574 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.130987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131562 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131639 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131770 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.131859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132235 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132489 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132610 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.132994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133093 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.133882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.134037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.134191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.134303 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.134537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.134617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.134770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.135924 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136205 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136446 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136745 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136912 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.136993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137408 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137489 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.137930 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138163 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138414 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138495 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138658 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.138978 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139432 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139526 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139676 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139758 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.connection = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.139927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140170 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140251 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140511 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140885 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.140965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141667 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141828 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.141927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142153 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142308 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142390 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142648 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.142911 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143360 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.143956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.144037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.144100 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.144171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.144235 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87474) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:05:03.144419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.144776 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.145020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.145319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.145537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] role.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.145788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] role.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.146022 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.146274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.146525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.146776 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.147025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.147275 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.147557 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.147809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.148060 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.148294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.148549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.148798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.149050 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.149301 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.149907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.150179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.150399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.150656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.150910 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.151166 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.151446 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.151690 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.151948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.152192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.152429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.152666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.152902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.153158 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.153450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.153734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.153975 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.154238 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.154490 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.154732 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.154995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.155267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.155553 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.155816 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.156067 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.156308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.156556 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.156803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.157053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.157294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.157551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.157768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.158016 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.158267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.158504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.158750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.159048 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.159311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.connection = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.159583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.159836 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.160076 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.160382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.160673 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.160911 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.161149 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.161389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.161639 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.161878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.162126 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.162365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.162616 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.162856 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.163103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.163338 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.163672 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.163967 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 25 19:05:03.164140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87475) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 25 19:05:03.175195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.175492 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.175722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.185907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.189863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.190101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.190332 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.199694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.217662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.217914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.222538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.222766 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.274191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.274754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.325116 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.325395 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.326503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.326756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.395667 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396038 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.396950 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.397173 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.397395 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.397614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.420788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421403 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421648 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.421897 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.422106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.422232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.422493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.422807 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.423037 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.433514 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.433801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.446666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.446985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447211 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447362 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447655 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.447844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.448005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87475) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.448131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.448213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87474) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 25 19:05:03.466058 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.466300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:05:03.466425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.466579 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:05:03.466666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.466812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:05:03.466941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467244 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 25 19:05:03.467328 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467639 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467766 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.467949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.468142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479383 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479650 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.479933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.480025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.488192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.488319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.491525 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.491656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.491801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.491945 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492544 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492669 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492800 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.492893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.493091 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.493216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.493337 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.493441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.493632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.493757 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.494014 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.494140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.494263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.494354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.494564 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.521307 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.522450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.522952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.523234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.524156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.524436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.531175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.531452 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.531748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.534342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.534853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.535344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.541959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.542258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.545453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.545923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.547315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.547637 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.547923 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.548204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.548610 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.548886 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.549169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.549438 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.551344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.551819 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.552200 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.552511 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.552969 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.553273 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.553583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.553865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.569368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.569720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.573651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.573949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.574430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.578534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.578768 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.579056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.582736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.583042 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.583795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.587435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.588205 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.591045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.591320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.591671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.591881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.592099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.592347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.592626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.595519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.595824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.596124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.596525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.596813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.597112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.611495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.611765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.612053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.612323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.616602 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.616894 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.617165 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.617427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.620332 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.622131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.622432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.625495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.625689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.625797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.626040 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.626322 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.626596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.627324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.627631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.630794 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.631080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.631363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.631786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.632076 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.640117 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.640403 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.640693 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.640974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.641252 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.641525 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.641801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.645496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.645781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.646062 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.646344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.646630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.646915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.647189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.659640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.663127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.665279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.666522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.668159 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.668682 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.669816 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.670090 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.670418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.672066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.673660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.675290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.675609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.675977 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.678166 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.679814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.683011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.683302 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.683576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.683707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.683893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.685348 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.688610 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.688907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.689200 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.689484 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.693115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.693410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.693686 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.698655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.698958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.699241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.701686 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87474) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.701966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.702247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.702522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.702810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.703426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.703688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.703957 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.704208 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.704472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.704753 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.705023 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.705287 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.705551 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87474) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.707693 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87475) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 25 19:05:03.707979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.708262 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.708540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.708823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.709097 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.709383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.709659 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.709915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.710183 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.710452 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.710736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.711013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.711288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87475) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 25 19:05:03.743872 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b71f5de9c0 pid: 87474 (default app) Jul 25 19:05:03.747428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2da0-57af-40e6-81ff-2235256f0051 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:03.747840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2da0-57af-40e6-81ff-2235256f0051 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:03.748261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cc2da0-57af-40e6-81ff-2235256f0051 None None] PATH_INFO: `/v3` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:03.750317 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b71f5de9c0 pid: 87475 (default app) Jul 25 19:05:03.752988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 1/1] 10.222.0.112 () {50 vars in 796 bytes} [Mon Jul 25 19:05:03 2022] GET /identity/v3/ => generated 256 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:12.233958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.234499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.234499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.238856 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 1/2] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:12 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:12.245578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:12.246156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:12.246156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:12.422663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: INFO dbcounter [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] Registered counter for database keystone Jul 25 19:05:12.444891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG oslo_db.sqlalchemy.engines [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87474) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:05:12.453473 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writer thread running {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:05:12.632165 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG passlib.handlers.bcrypt [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87474) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 19:05:12.632588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG passlib.handlers.bcrypt [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87474) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 19:05:12.687543 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:12.689177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:12.836297 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 2/3] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:12 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 592 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 25 19:05:13.019235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.200709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: INFO dbcounter [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] Registered counter for database keystone Jul 25 19:05:13.222449 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG oslo_db.sqlalchemy.engines [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87475) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 25 19:05:13.229925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writer thread running {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 25 19:05:13.350320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f73806-3bf2-49fb-a301-7d0b15b4a602 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.355071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.355860 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.356145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.356425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.366057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:13.416145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING keystone.common.rbac_enforcer.enforcer [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 19:05:13.416475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73739a9e-f267-423f-8c63-7e8f63e4d155 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:13.427033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 2/4] 10.222.0.112 () {58 vars in 1329 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:05:13.437655 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:13.461152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470d6f1-1e53-40fc-8469-7cf118cd9cbe None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:13.465947 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:13.467101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:13.467423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:13.467697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] PATH_INFO: `/v3/projects/58b503a03d964e16b18f95569d131e22` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:13.469253 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] RBAC: Authorizing `identity:get_project(project_id=58b503a03d964e16b18f95569d131e22)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:13.521688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 25 19:05:13.522024 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3f8da5-2907-4fba-80c3-792d9b64c897 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:13.526785 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 3/5] 10.222.0.112 () {56 vars in 1212 bytes} [Mon Jul 25 19:05:13 2022] GET /identity/v3/projects/58b503a03d964e16b18f95569d131e22 => generated 345 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:15.794078 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb8b0-0718-4484-bb21-88e121549344 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.794758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb8b0-0718-4484-bb21-88e121549344 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.795023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccb8b0-0718-4484-bb21-88e121549344 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.800920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 3/6] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:15 2022] GET /identity => generated 271 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:15.808853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.809440 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.809440 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.834504 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:15.836204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:15.845756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 4/7] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:15 2022] POST /identity/v3/auth/tokens => generated 915 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 25 19:05:15.872668 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb8b0-0718-4484-bb21-88e121549344 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.885903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccb8b0-0718-4484-bb21-88e121549344 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.890681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dca4be4-70be-4497-a4e8-0a3e93780b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.891535 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4be4-70be-4497-a4e8-0a3e93780b1c admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.891666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4be4-70be-4497-a4e8-0a3e93780b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.892401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dca4be4-70be-4497-a4e8-0a3e93780b1c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.903578 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4be4-70be-4497-a4e8-0a3e93780b1c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.905795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dca4be4-70be-4497-a4e8-0a3e93780b1c admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.927076 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 4/8] 10.222.0.112 () {58 vars in 1329 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/auth/tokens => generated 915 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 25 19:05:15.932573 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:15.946308 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda7351-032e-41cd-957e-3cce76d0ddaa None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:15.953997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a64b8ad-b566-40da-a669-811bd5527f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:15.954908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b8ad-b566-40da-a669-811bd5527f9f admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:15.955203 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b8ad-b566-40da-a669-811bd5527f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:15.955523 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a64b8ad-b566-40da-a669-811bd5527f9f admin admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:15.957107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b8ad-b566-40da-a669-811bd5527f9f admin admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:15.959036 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a64b8ad-b566-40da-a669-811bd5527f9f admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:15.960768 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 5/9] 10.222.0.112 () {56 vars in 1203 bytes} [Mon Jul 25 19:05:15 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:18.418590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd4aeb-8310-425d-bf46-6324a6ab6b38 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.419152 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd4aeb-8310-425d-bf46-6324a6ab6b38 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.419451 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd4aeb-8310-425d-bf46-6324a6ab6b38 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.421245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 5/10] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:18 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:18.426989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.427750 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.427750 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.447024 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:18.448280 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:18.460834 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135968f1-057f-4bfe-a7be-deed85adc194 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.461251 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135968f1-057f-4bfe-a7be-deed85adc194 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.461537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135968f1-057f-4bfe-a7be-deed85adc194 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.462901 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 6/11] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:05:18.468756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.469120 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.469469 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.519857 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG passlib.handlers.bcrypt [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87475) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 25 19:05:18.520347 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG passlib.handlers.bcrypt [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87475) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 25 19:05:18.543675 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 6/12] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:18.565859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:18.567579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:18.568367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.593978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.687513 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 7/13] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:18.688019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b6f2b-ed82-4267-97c2-d73c9fecc945 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:18.712218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.726492 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:18.727167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.727482 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.727768 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.803524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:18.805029 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:18.821509 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8959b4-889b-40a5-84f5-14466b258ddf None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:18.824315 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.837136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:18.865430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:18.866520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:18.866795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:18.867079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:18.882173 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:18.893853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:18.894958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:18.896202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 8/14] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:18.901375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:18.919477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 7/15] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:18.925041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.013716 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f26d4b-c7ff-4e36-a470-a52fb076b770 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.042034 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8ef88-89cd-45cd-8f9b-ce90e890b98c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.055181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.055889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.056167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.056440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.057200 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:19.057512 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.059056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.072331 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 9/16] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:19.080352 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.084475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.094680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.095549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.095862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.096207 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.107736 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.109283 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.126010 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:19.134495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:19.135645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:19.137141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:19.137141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:19.137141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:19.137141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:19.137141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 8/17] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:19.141804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.226111 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccecd46-fc80-4610-8bf5-78db3f2537ac None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.270870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.271870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.272157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.272436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.274169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.275787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.277750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 10/18] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:19.284260 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.289039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d338a479-d094-4f74-ac51-20c0845692a8 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.324096 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.324813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.325102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.325380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.326115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:19.326420 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.328198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.349524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 9/19] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:19.404593 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.414385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5568d78-aaf7-4c95-b12f-075f3346db3a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.454194 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545443c-9319-4166-b1a8-42069f7dcafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.455018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545443c-9319-4166-b1a8-42069f7dcafb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.455305 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545443c-9319-4166-b1a8-42069f7dcafb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.455616 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545443c-9319-4166-b1a8-42069f7dcafb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.456868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545443c-9319-4166-b1a8-42069f7dcafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.458380 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545443c-9319-4166-b1a8-42069f7dcafb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.460516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 11/20] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/domains/default => generated 200 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:19.474944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:19.514588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:19.600154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aafcd1-24ec-42c8-a469-f3665251146a None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:19.643300 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:19.644198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:19.644522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:19.644896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:19.645660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.domain.id=default, user.id=7930508aa7a648b2940c5e4fcfe5b1be) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:19.646114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:19.647723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e43224-f7d9-4e7c-8bd5-4fbf561f833d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:19.660216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 10/21] 10.222.0.112 () {56 vars in 1327 bytes} [Mon Jul 25 19:05:19 2022] GET /identity/v3/role_assignments?user.id=7930508aa7a648b2940c5e4fcfe5b1be&scope.domain.id=default&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 234 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:22.388313 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffccb2-2f4e-44cb-8ecf-b49e2601765c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.389128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffccb2-2f4e-44cb-8ecf-b49e2601765c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.389263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ffccb2-2f4e-44cb-8ecf-b49e2601765c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.391677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 12/22] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:22 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:22.397746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.398514 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.398514 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.428708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:22.429946 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:22.492032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d473-27c9-4d84-a4e3-ae68d797866b None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.492350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d473-27c9-4d84-a4e3-ae68d797866b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.492605 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763d473-27c9-4d84-a4e3-ae68d797866b None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.494292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 13/23] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:22.500235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803f33a-97a1-46e1-93d2-3378845fc4d3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.500538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803f33a-97a1-46e1-93d2-3378845fc4d3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.500793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9803f33a-97a1-46e1-93d2-3378845fc4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-9803f33a-97a1-46e1-93d2-3378845fc4d3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:22.537043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-9803f33a-97a1-46e1-93d2-3378845fc4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:22.546532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 11/24] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:22.597544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.659915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.671744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 14/25] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:22.673318 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd1e96-0958-4f3f-8d62-8df763643b0c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.673618 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd1e96-0958-4f3f-8d62-8df763643b0c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.673901 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dd1e96-0958-4f3f-8d62-8df763643b0c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.679595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 15/26] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:22 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:22.680981 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.681276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.681562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.718298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:22.719538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:22.783682 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f49c86-adfa-49a1-a8c2-9d4653f3ff4f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:22.862665 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:22.864490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:22.864985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:22.865287 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:22.874949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 16/27] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:22.884242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:22.894735 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:22.897410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:05:22.934425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:22.935271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:22.936139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:05:22.936139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:05:22.936139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:05:22.936139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:22.937428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 12/28] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:22.937940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:22.944503 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.094472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.106711 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e44e0d-238f-45f2-8b2f-9a742e248a25 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.122464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc25a4-5b3f-44d0-8c55-6e14c3ee3347 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.170101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.171678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.172320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.172687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfc79b-802d-4d31-bab9-bc86c5b8312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.172871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.173368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc79b-802d-4d31-bab9-bc86c5b8312a None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.173656 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc79b-802d-4d31-bab9-bc86c5b8312a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.174176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfc79b-802d-4d31-bab9-bc86c5b8312a None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.174944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc79b-802d-4d31-bab9-bc86c5b8312a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.176889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfc79b-802d-4d31-bab9-bc86c5b8312a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.197584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:23.213782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:23.214725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:23.215534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:23.217770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 17/29] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:23.218169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.352919 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.355321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 13/30] 10.222.0.112 () {60 vars in 1136 bytes} [Mon Jul 25 19:05:22 2022] POST /identity/v3/roles => generated 226 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:23.358920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a0e6-fd3c-4cd3-ad5a-f69acf9a5dae None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.359474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a0e6-fd3c-4cd3-ad5a-f69acf9a5dae None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.360050 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02a0e6-fd3c-4cd3-ad5a-f69acf9a5dae None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.362330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 14/31] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:23 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:23.369954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a0e6-fd3c-4cd3-ad5a-f69acf9a5dae None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.376040 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb12595-0152-492e-9602-940e351186b6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.429296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.430082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.430266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.435428 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.435428 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:23.435428 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.435428 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb8fe5d-51ce-4eea-be59-f568c0f11a51 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.512036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 18/32] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.514424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.514933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.515452 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.535948 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02a0e6-fd3c-4cd3-ad5a-f69acf9a5dae None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.561543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:23.562853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:23.621897 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.623044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.623610 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.624090 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.625477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:23.626179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.633824 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.654722 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 19/33] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:23 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:23.655342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.660185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 15/34] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.665960 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.669298 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.815626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:23.817777 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63312c6-5d4e-42f3-b5ad-9c00dec36d6c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.857318 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d278e27d-3ac2-4d39-829e-dbcaac6c7342 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:23.866463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.867441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.867731 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.868108 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.870410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.871937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.874664 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 16/35] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:23 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:23.880361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:23.915203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fccd28-f114-4468-9968-d5ebd6e605d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:23.916197 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fccd28-f114-4468-9968-d5ebd6e605d1 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:23.916727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fccd28-f114-4468-9968-d5ebd6e605d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:23.917232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fccd28-f114-4468-9968-d5ebd6e605d1 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:23.918292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fccd28-f114-4468-9968-d5ebd6e605d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:23.920420 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fccd28-f114-4468-9968-d5ebd6e605d1 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:23.973129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.008917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb3441-2161-4d29-8418-b82015dcddde None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.045267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.046182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.046632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.047042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.047955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.049655 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.065371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 17/36] 10.222.0.112 () {60 vars in 1136 bytes} [Mon Jul 25 19:05:23 2022] POST /identity/v3/roles => generated 220 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:24.066586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.085703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 20/37] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:05:23 2022] POST /identity/v3/projects => generated 302 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:24.087680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5463f-8c1f-496e-841a-669a16a32c9f None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.088084 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5463f-8c1f-496e-841a-669a16a32c9f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.088466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5463f-8c1f-496e-841a-669a16a32c9f None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.090281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 21/38] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:24.101395 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5a5cd-f7dd-451c-a156-320ce2266900 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.102036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5a5cd-f7dd-451c-a156-320ce2266900 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.102582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d5a5cd-f7dd-451c-a156-320ce2266900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.141760 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-66d5a5cd-f7dd-451c-a156-320ce2266900 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:24.151423 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-66d5a5cd-f7dd-451c-a156-320ce2266900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:24.221824 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f421f25-e6b2-4219-aeb0-6bb5580e1cad None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.263176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 22/39] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:24.265249 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc503b-84fa-4fde-a8c2-6fbd39f3ff98 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.265645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc503b-84fa-4fde-a8c2-6fbd39f3ff98 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.266021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc503b-84fa-4fde-a8c2-6fbd39f3ff98 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.267797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 23/40] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:24.272698 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.275002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.275839 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.276065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.276661 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.277160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.277264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.277734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.278557 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.280782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.287632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 18/41] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/domains/default => generated 200 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:24.289057 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.304668 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:24.306669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:24.389980 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.418544 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 24/42] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:24.419817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.455216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9cf5f-e41d-4e7a-a5b1-0b7fde4f5eb3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.490057 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.490988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.491472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.491769 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] PATH_INFO: `/v3/domains/default/users/7930508aa7a648b2940c5e4fcfe5b1be/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.494075 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7930508aa7a648b2940c5e4fcfe5b1be, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.495672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.510339 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 19/43] 10.222.0.112 () {58 vars in 1366 bytes} [Mon Jul 25 19:05:24 2022] PUT /identity/v3/domains/default/users/7930508aa7a648b2940c5e4fcfe5b1be/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:24.511191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.535875 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134eeb58-2bf8-4d8d-b871-c02ce212195b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.576646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.577483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.577771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.578053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.579456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.581258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.581708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.583014 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 25/44] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:24 2022] GET /identity/v3/domains/default => generated 200 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:24.589121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:24.633530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfafadf-fcf9-4002-a20a-0aa6831d4cac None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.651967 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:24.675671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b8757-5471-4037-9124-44337a61da23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.676484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b8757-5471-4037-9124-44337a61da23 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.676609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b8757-5471-4037-9124-44337a61da23 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.676854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b8757-5471-4037-9124-44337a61da23 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.677595 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b8757-5471-4037-9124-44337a61da23 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.679642 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b8757-5471-4037-9124-44337a61da23 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.698129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 20/45] 10.222.0.112 () {60 vars in 1136 bytes} [Mon Jul 25 19:05:24 2022] POST /identity/v3/roles => generated 224 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:24.711795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75718035-bfa1-44e5-97f5-056adb5b33f1 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:24.766110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db55d03-bf62-4048-8fc2-1ade5c068f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:24.766810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55d03-bf62-4048-8fc2-1ade5c068f0c None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:24.767309 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55d03-bf62-4048-8fc2-1ade5c068f0c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:24.767583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db55d03-bf62-4048-8fc2-1ade5c068f0c None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:24.768189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55d03-bf62-4048-8fc2-1ade5c068f0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:24.769717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db55d03-bf62-4048-8fc2-1ade5c068f0c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:24.802299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 26/46] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:05:24 2022] POST /identity/v3/projects => generated 313 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:05:26.828169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed912b-ea6a-4f1d-9427-dc8d96d8f495 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:26.829067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed912b-ea6a-4f1d-9427-dc8d96d8f495 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:26.829067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed912b-ea6a-4f1d-9427-dc8d96d8f495 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:26.830088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 21/47] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:26.836059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353467c7-f926-40d7-bcbf-d58ea2d7a7a3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:26.836516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353467c7-f926-40d7-bcbf-d58ea2d7a7a3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:26.836592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353467c7-f926-40d7-bcbf-d58ea2d7a7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:26.857779 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-353467c7-f926-40d7-bcbf-d58ea2d7a7a3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:26.858972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-353467c7-f926-40d7-bcbf-d58ea2d7a7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:26.943925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 27/48] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:26.969028 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed912b-ea6a-4f1d-9427-dc8d96d8f495 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.059752 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063716d-60ac-4885-a036-dbb680ef6795 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.060045 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063716d-60ac-4885-a036-dbb680ef6795 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.060580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b063716d-60ac-4885-a036-dbb680ef6795 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.062030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 28/49] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:27.068775 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.069191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.069569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.089545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:27.090678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:27.099319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ed912b-ea6a-4f1d-9427-dc8d96d8f495 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.120660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:27.127885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:27.141243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.142219 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.142379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.142620 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.156010 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:27.164945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:27.165882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:27.166690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 22/50] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:05:27.172209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.178321 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 29/51] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:27.203735 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.282813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ea869-6739-40ab-af55-2f4f3447edf0 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.311845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0decc-d47e-484f-8c39-6507a0121f57 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.317357 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.318035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.318320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.318606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.319364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:27.319708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:27.322155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:27.335145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 23/52] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:27.341997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.352478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.353339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.353741 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.354179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.355587 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:27.357041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:27.358709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 30/53] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:27.364476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.398843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:27.400524 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:27.478542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a8203-0338-48b5-b61a-381db46ac3ac None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.481851 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74c15b3-c27c-46dd-8503-05ba9847b368 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.515413 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.516113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.516409 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.516679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.517701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:27.519233 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:27.523176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.524114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.524405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.524695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.526000 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:27.527488 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:27.529153 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 24/54] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:27 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:27.536709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.550359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 31/55] 10.222.0.112 () {60 vars in 1145 bytes} [Mon Jul 25 19:05:27 2022] POST /identity/v3/projects => generated 299 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:27.668577 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdb5020-0748-41bd-88b8-72caac2b094d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.678932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:27.710046 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fe4758-2273-47e5-9971-ed622ecb6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.710870 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4758-2273-47e5-9971-ed622ecb6e6e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.711160 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4758-2273-47e5-9971-ed622ecb6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.711474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fe4758-2273-47e5-9971-ed622ecb6e6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.712874 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4758-2273-47e5-9971-ed622ecb6e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:27.714546 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fe4758-2273-47e5-9971-ed622ecb6e6e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:27.716292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 25/56] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:27 2022] GET /identity/v3/domains/default => generated 200 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:27.722628 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:27.826291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:27.847277 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2414b5-e14d-477f-9d11-ec79f1091bbe None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:27.882104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:27.882770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:27.883054 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:27.883333 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:27.884260 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.domain.id=default, user.id=7930508aa7a648b2940c5e4fcfe5b1be) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:27.884602 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:27.886092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a09a21-5046-456a-b6f2-2064a6b4cba6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:27.895468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 32/57] 10.222.0.112 () {56 vars in 1327 bytes} [Mon Jul 25 19:05:27 2022] GET /identity/v3/role_assignments?user.id=7930508aa7a648b2940c5e4fcfe5b1be&scope.domain.id=default&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 532 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:29.821246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7806b0-a51b-4680-8d27-0d6bc9be3ae4 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.822039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7806b0-a51b-4680-8d27-0d6bc9be3ae4 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.822185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7806b0-a51b-4680-8d27-0d6bc9be3ae4 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.823799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 26/58] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:29.830169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:29.830541 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:29.830729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:29.851407 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:29.852684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:29.930360 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 33/59] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:29.956515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7806b0-a51b-4680-8d27-0d6bc9be3ae4 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.078305 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7806b0-a51b-4680-8d27-0d6bc9be3ae4 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.121993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa52d0-f30a-453b-bef4-e867b304d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.122869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa52d0-f30a-453b-bef4-e867b304d29b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.123340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa52d0-f30a-453b-bef4-e867b304d29b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.123685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa52d0-f30a-453b-bef4-e867b304d29b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.124862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa52d0-f30a-453b-bef4-e867b304d29b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.126366 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa52d0-f30a-453b-bef4-e867b304d29b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.128212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 27/60] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:29 2022] GET /identity/v3/domains/default => generated 200 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:30.134497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:30.240066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:30.264400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78310d3e-09b2-4b6c-9c6a-892be67006d5 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:30.306932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b82ed-2f6f-485b-ba8f-bc6eb32f09ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:30.307659 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b82ed-2f6f-485b-ba8f-bc6eb32f09ec None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:30.307951 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b82ed-2f6f-485b-ba8f-bc6eb32f09ec None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:30.308244 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b82ed-2f6f-485b-ba8f-bc6eb32f09ec None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:30.308966 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b82ed-2f6f-485b-ba8f-bc6eb32f09ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:30.310483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b82ed-2f6f-485b-ba8f-bc6eb32f09ec None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:30.340473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 34/61] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:30 2022] POST /identity/v3/users => generated 276 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:34.126435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f247f7-ba08-46ba-8512-ea73e2543a58 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.126959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f247f7-ba08-46ba-8512-ea73e2543a58 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.126959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f247f7-ba08-46ba-8512-ea73e2543a58 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.128315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 28/62] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.141277 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805ece-e8c9-46ea-a0a4-2ac3fe9f214f None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.142294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805ece-e8c9-46ea-a0a4-2ac3fe9f214f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.142778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50805ece-e8c9-46ea-a0a4-2ac3fe9f214f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.168631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-50805ece-e8c9-46ea-a0a4-2ac3fe9f214f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:34.169994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-50805ece-e8c9-46ea-a0a4-2ac3fe9f214f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:34.262965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 35/63] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:34.273171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e91cc2-8967-4f98-8698-8c0938266419 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.273819 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e91cc2-8967-4f98-8698-8c0938266419 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.274333 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e91cc2-8967-4f98-8698-8c0938266419 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.276477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 29/64] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.289106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42bfe9-b650-4130-8544-1561accf8d36 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.289404 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42bfe9-b650-4130-8544-1561accf8d36 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.289666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42bfe9-b650-4130-8544-1561accf8d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.296451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e91cc2-8967-4f98-8698-8c0938266419 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.320785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-5e42bfe9-b650-4130-8544-1561accf8d36 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:34.322159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-5e42bfe9-b650-4130-8544-1561accf8d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:34.417527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.444685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.468239 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 36/65] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:34.470064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab790c-fe38-4320-8368-afe353fa17b5 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.470553 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab790c-fe38-4320-8368-afe353fa17b5 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.471025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab790c-fe38-4320-8368-afe353fa17b5 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.472824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 37/66] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.481427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.481427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.481427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.501603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e91cc2-8967-4f98-8698-8c0938266419 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.524826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:34.526611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:34.548170 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.549013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.549303 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.549586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.565162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:34.575839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.576982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:34.577799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 30/67] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.578462 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.619898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 38/68] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:34.621534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.714691 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867fe60b-b590-4142-b83f-2d93f96a85fe None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.717179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.759591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2676d-0928-443d-a156-57b160b6b65a None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.761624 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.762720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.763201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.763544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.774647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:34.782490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.783666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 31/69] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.784617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.791128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.802551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.803228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.803548 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.803830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.804591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:34.804894 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.806319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3489aff-8081-40b3-b3a5-419bad33df02 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.814828 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 39/70] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.816126 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82536c-d445-4967-8514-d120245f7a38 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.816413 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82536c-d445-4967-8514-d120245f7a38 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.816688 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82536c-d445-4967-8514-d120245f7a38 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.820444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 40/71] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.820444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f125a-6312-4d85-84a9-26343b57f247 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.820444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f125a-6312-4d85-84a9-26343b57f247 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.820444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f125a-6312-4d85-84a9-26343b57f247 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.820735 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 41/72] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:34 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:34.821388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f125a-6312-4d85-84a9-26343b57f247 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.892802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54bf92-8618-4696-8e6f-5a1706bccbce None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.929049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.930156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.930444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.930722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.934006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81f125a-6312-4d85-84a9-26343b57f247 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:34.943659 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:34.952204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:34.953094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:34.953878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 32/73] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:34.954516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:34.973582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:34.974494 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.974778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.975055 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:34.975870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:34.976183 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:34.977582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97ed0f0-4d2e-449e-9e63-3bc43fefb9a5 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:34.980762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:34.987380 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 42/74] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:34.989025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab6fc-f4ad-49af-bdbf-5d8764ff775c None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:34.989319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab6fc-f4ad-49af-bdbf-5d8764ff775c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:34.989595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85ab6fc-f4ad-49af-bdbf-5d8764ff775c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.009970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-a85ab6fc-f4ad-49af-bdbf-5d8764ff775c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:35.011203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-a85ab6fc-f4ad-49af-bdbf-5d8764ff775c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:35.055886 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.057998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9cdf9-b014-474a-bedb-7afd877ee71e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.079677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 43/75] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:34 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:35.091596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.091596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.091596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.095892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.096791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.097078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.097330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.098867 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:35.100083 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:35.115015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.116561 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.118333 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 33/76] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:34 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.119163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.178148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 44/77] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:35 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:35.179013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.211887 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.231703 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eeb46d-4b19-461c-a86d-64ff6d87d316 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.267747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.268425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.268712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.268990 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.269732 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:35.270456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.271475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.280103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 34/78] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.281143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.300450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee7a7a-02a3-4da0-b724-02d12b4d48ba None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.310448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.339361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.340289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.340575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.340856 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.342116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.343608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.345424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 45/79] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.346232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.389603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1380149c-8661-435f-8bc5-b510570efdfc None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.427106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.427963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.428256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.428538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.429805 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.431443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.433357 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 35/80] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/domains/default => generated 200 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.433925 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.451901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.459313 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ab60c-31cf-47e3-a910-1dd94d473772 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.496203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.496707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.497026 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.497599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.552043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.557794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba108db-c01b-4223-82ea-f3b19be911fa None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.578735 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.580276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.599593 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.600523 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.600792 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.601085 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.613869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:35.621989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:35.623416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:35.624230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 36/81] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:35.625388 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.694688 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 46/82] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:35.695648 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.711756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.744026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5584d6-2e7a-49f5-9a43-c2421ca786f4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.779515 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.780928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.782012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.782310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.782598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.783977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.785467 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.787145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 37/83] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:35.787941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:35.812127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe909c-3bd3-4bd0-93a0-9e455ec5b956 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.872745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.873556 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.873840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.874109 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.907916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f6e8d-a03d-412a-b893-e61032325465 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:35.945251 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:35.946023 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:35.946370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:35.946663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:35.947446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.948916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.965475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:35.966483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:35.967362 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:35.984604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 38/84] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:35 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:35.985752 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.073792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.110069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 47/85] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:36.110069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.138610 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27547a07-9ef0-4914-a074-193d6e86286b None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.186860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.187667 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.189194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.189194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.189194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:36.189417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.190801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.203319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 39/86] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:35 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.204230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.255216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf552123-b8db-4993-be57-acdf5c184c83 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.287680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.323558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.324558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.325498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.325498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.330456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.332100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.333817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 48/87] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.334600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.353133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7669dc-5ace-462e-bfb4-9d44aa55aea3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.410546 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.411648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.411964 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.412404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.414019 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.497654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf97a18-0051-4f7c-b1d6-6a227d50fac6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.526449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.528511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.542942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.545016 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.545759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.546503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.548902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.550948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.553617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 49/88] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.554737 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.618018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.686422 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 40/89] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:36.687857 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.702956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2474d2f-8887-4ac8-9ecf-d485a257f5cb None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.718977 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:36.742854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.744824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.745685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.746600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.748705 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.750533 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.752708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 50/90] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.753929 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.878804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea2323-19fb-4d50-a7f3-4b2e99f878b2 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.892671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7505c5-d3c9-4ffa-9ad9-00563ca12db9 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:36.918697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.919847 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.920352 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.920829 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.921983 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=7930508aa7a648b2940c5e4fcfe5b1be) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:36.922521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.924477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:36.931880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 51/91] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/role_assignments?user.id=7930508aa7a648b2940c5e4fcfe5b1be&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:36.933118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:36.978495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:36.979656 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:36.980349 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:36.980828 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:36.981909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=a3979e4c2a5e4d198e1d5e640a715e94) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:36.984706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:36.986683 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.007278 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 41/92] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/role_assignments?user.id=a3979e4c2a5e4d198e1d5e640a715e94&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=51992cc8771e4114ab2620b57493b066 => generated 260 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.011931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.080045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.099806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.244638 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621c4045-11ab-4a8d-a4aa-f7343ca3c5d5 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.281609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8acf04-ef2d-40d9-82ad-9fe35e351431 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.294651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.296383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.296912 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.297393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.299584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.303472 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.305908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 52/93] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:36 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.312652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.373256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.373950 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.374224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.374511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.449270 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e52dde-ce16-4c16-b38f-ee8e7e2e6a0c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.474035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.519360 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.522170 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.537470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.538569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.539066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.539424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.540597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] RBAC: Adding query filter params (role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=a3979e4c2a5e4d198e1d5e640a715e94) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:37.540994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.542994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.552011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 53/94] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/role_assignments?user.id=a3979e4c2a5e4d198e1d5e640a715e94&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=dd47724fb39b480896a4a89456effdf6 => generated 260 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.567863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:37.676265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 42/95] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:37.682653 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:37.813701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317b1eb-0af1-47d8-b8e0-7df8815de245 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:37.863120 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e2befe-9b70-4abc-b21d-27dfffed2405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:37.864538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2befe-9b70-4abc-b21d-27dfffed2405 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:37.865057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2befe-9b70-4abc-b21d-27dfffed2405 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:37.865544 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e2befe-9b70-4abc-b21d-27dfffed2405 None admin] PATH_INFO: `/v3/projects/5a82b57732074ac9a11489e6a2e55957` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:37.867251 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2befe-9b70-4abc-b21d-27dfffed2405 None admin] RBAC: Authorizing `identity:get_project(project_id=5a82b57732074ac9a11489e6a2e55957)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:37.869169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e2befe-9b70-4abc-b21d-27dfffed2405 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:37.871287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 54/96] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/projects/5a82b57732074ac9a11489e6a2e55957 => generated 313 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:37.877916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:38.036784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ff5ce-6fcc-416d-9c29-efc737d5d496 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:38.088127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:38.112878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:38.113911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:38.114341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:38.114801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:38.116377 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=5a82b57732074ac9a11489e6a2e55957, user.id=a3979e4c2a5e4d198e1d5e640a715e94) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:38.116914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:38.119507 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297907a-098f-4ab7-97de-c6e08472c137 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:38.128045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 43/97] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:37 2022] GET /identity/v3/role_assignments?user.id=a3979e4c2a5e4d198e1d5e640a715e94&scope.project.id=5a82b57732074ac9a11489e6a2e55957&role.id=51992cc8771e4114ab2620b57493b066 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:39.337136 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c004c1-5aff-4c4b-8c41-45600d412dc3 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.338186 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c004c1-5aff-4c4b-8c41-45600d412dc3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.338701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c004c1-5aff-4c4b-8c41-45600d412dc3 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.340418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 55/98] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:39.347053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd7be9-f95e-4d7e-9b6e-badc106cd7f6 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.347761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd7be9-f95e-4d7e-9b6e-badc106cd7f6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.347761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd7be9-f95e-4d7e-9b6e-badc106cd7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.376467 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f7fd7be9-f95e-4d7e-9b6e-badc106cd7f6 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:39.378036 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f7fd7be9-f95e-4d7e-9b6e-badc106cd7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:39.470087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 44/99] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:39.511425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c004c1-5aff-4c4b-8c41-45600d412dc3 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.579772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:39.657897 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c004c1-5aff-4c4b-8c41-45600d412dc3 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.661206 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35066f32-bf70-4fd6-bd18-3df6e288c77d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.661498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35066f32-bf70-4fd6-bd18-3df6e288c77d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.661783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35066f32-bf70-4fd6-bd18-3df6e288c77d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.663195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 45/100] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:39.677026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.677401 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.677590 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.716249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:39.716591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.717335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.717512 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:39.717613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.717891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.730092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:39.738554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:39.739504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:39.740363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 56/101] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:39.749613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.839640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 46/102] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:39.908462 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e60fb-3801-4d46-b8a6-fd2493ecd9d3 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:39.911757 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:39.925178 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:39.981927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:39.982743 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:39.983268 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:39.983599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:39.984620 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:39.985093 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:39.986764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.018066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 57/103] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:40.028731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.037413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.205493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d61c08-c558-4be0-a2c2-0689c91bb6e8 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.262560 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154b4a1-61f3-460b-b8ef-71b987807ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.263377 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154b4a1-61f3-460b-b8ef-71b987807ae4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.263683 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154b4a1-61f3-460b-b8ef-71b987807ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.263960 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154b4a1-61f3-460b-b8ef-71b987807ae4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.265305 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154b4a1-61f3-460b-b8ef-71b987807ae4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.266769 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154b4a1-61f3-460b-b8ef-71b987807ae4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.268550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 47/104] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:39 2022] GET /identity/v3/domains/default => generated 200 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:40.269796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bf19-aabe-4b9f-9f93-dd83b7326f2f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.270003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bf19-aabe-4b9f-9f93-dd83b7326f2f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.270284 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d39bf19-aabe-4b9f-9f93-dd83b7326f2f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.271649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 48/105] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:40 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:40.284774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.285049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.285331 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.300829 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eddb359-a728-4110-a570-78b6391c5a39 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.322976 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:40.324549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:40.377709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.379310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.379895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.380407 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] PATH_INFO: `/v3/users/a87806fc41e341d881ce56659092f1d5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.413358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] RBAC: Authorizing `identity:get_user(user_id=a87806fc41e341d881ce56659092f1d5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.419867 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.422171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 58/106] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/users/a87806fc41e341d881ce56659092f1d5 => generated 290 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:40.423677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.463604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 49/107] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:40.465295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.499424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.588064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.641383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05290b6-455d-4ecc-be31-d314d0da0f5a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.679918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.681021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.681535 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.682065 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.683070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.684803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:40.698798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6624cc-e0d6-465d-ad79-660f80d8d923 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.721211 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 59/108] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:05:40 2022] POST /identity/v3/projects => generated 303 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:40.722648 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:40.777048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72efa113-0a99-4ed0-9b47-07295404710e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:40.777897 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efa113-0a99-4ed0-9b47-07295404710e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:40.778184 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efa113-0a99-4ed0-9b47-07295404710e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:40.778460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72efa113-0a99-4ed0-9b47-07295404710e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:40.906056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:40.969245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efa113-0a99-4ed0-9b47-07295404710e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:40.969742 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159478c-41e7-404a-8d3d-9d64079a9bad None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:40.976185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72efa113-0a99-4ed0-9b47-07295404710e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.023037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.025759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.026047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.026329 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.053883 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:41.071478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:41.072464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:41.073223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:41.075641 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 60/109] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:41.089085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.090374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.204502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 50/110] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:40 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:41.206412 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1aec7-a1d8-43ad-84c6-f1adea07716a None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.206708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1aec7-a1d8-43ad-84c6-f1adea07716a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.206993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1aec7-a1d8-43ad-84c6-f1adea07716a None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.208476 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 51/111] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:41.215301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1aec7-a1d8-43ad-84c6-f1adea07716a None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.233419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2946b13-cace-4de2-93ab-f5a309cd5094 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.275548 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.276235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.276522 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.276800 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.277572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:41.277879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.279292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cea68d1-1dca-41ad-a252-9a2819a22d37 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.282889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.293291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 61/112] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:41.299838 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1bff4-3078-439e-a6bb-0e0b2595692f None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.300208 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1bff4-3078-439e-a6bb-0e0b2595692f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.300556 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1bff4-3078-439e-a6bb-0e0b2595692f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.320160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-5dc1bff4-3078-439e-a6bb-0e0b2595692f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:41.321531 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-5dc1bff4-3078-439e-a6bb-0e0b2595692f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:41.377722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1aec7-a1d8-43ad-84c6-f1adea07716a None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.419120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7e295-49fa-4044-b633-868b0ed692b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.420331 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 62/113] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:41.422298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92343e-6d92-49a2-8c67-130282c4dcfd None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.422717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92343e-6d92-49a2-8c67-130282c4dcfd None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.423112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92343e-6d92-49a2-8c67-130282c4dcfd None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.424707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 63/114] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:41.425548 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92343e-6d92-49a2-8c67-130282c4dcfd None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.428521 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7e295-49fa-4044-b633-868b0ed692b1 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.428991 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7e295-49fa-4044-b633-868b0ed692b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.429381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7e295-49fa-4044-b633-868b0ed692b1 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.432233 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7e295-49fa-4044-b633-868b0ed692b1 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.433977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7e295-49fa-4044-b633-868b0ed692b1 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.436248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 52/115] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.442415 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.442818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.443211 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.478959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:41.480343 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:41.490829 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.568237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92343e-6d92-49a2-8c67-130282c4dcfd None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.577364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 53/116] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:41.577364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.612197 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.620847 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.621851 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.622206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.622487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.623817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.625358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.627079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 64/117] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.627933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.713957 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272938df-5e80-438b-80d6-950fb633ec6a None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.766670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.767264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.767586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.767858 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.768712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] RBAC: Adding query filter params (role.id=6e4fac15600a46c5a7c117d4507040eb, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=a87806fc41e341d881ce56659092f1d5) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:41.769026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:41.770492 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7370b248-efe4-46b9-ad8b-89114cbef05d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:41.776718 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 54/118] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/role_assignments?user.id=a87806fc41e341d881ce56659092f1d5&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=6e4fac15600a46c5a7c117d4507040eb => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:41.777890 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8074a-f366-448c-9d05-e682f0b2125d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.778181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8074a-f366-448c-9d05-e682f0b2125d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.778533 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8074a-f366-448c-9d05-e682f0b2125d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.779914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 55/119] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:41 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:41.785328 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8074a-f366-448c-9d05-e682f0b2125d None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.796751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.807041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192eb538-2b77-4ea7-819e-7512c0f1a970 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.860716 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.862656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.863482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.863934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:41.882744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:41.893768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:41.894885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:41.895820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:41.897563 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 65/120] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:41.898191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:41.939562 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8074a-f366-448c-9d05-e682f0b2125d None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:41.983207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:41.987326 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59b9b1b-163f-4112-a844-b4b1f6e30975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:41.989330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b9b1b-163f-4112-a844-b4b1f6e30975 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:41.989330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b9b1b-163f-4112-a844-b4b1f6e30975 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:41.989330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59b9b1b-163f-4112-a844-b4b1f6e30975 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.002355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59b9b1b-163f-4112-a844-b4b1f6e30975 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-a59b9b1b-163f-4112-a844-b4b1f6e30975 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:42.013072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:42.013966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:42.015956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 56/121] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:42.017622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.017622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.017622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.043447 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:42.044654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:42.050649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8db8d-f3a1-4e55-8696-8623219bff8b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.091681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.092643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.093039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.093329 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.094593 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.096083 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.098128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 66/122] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:41 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.098961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.122032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.124636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 57/123] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:42 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:42.126905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.275214 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c1d4e-dd47-49a6-94bf-257d26be6413 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.312733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c59e802-3abb-4af8-b8a4-d7145cb158eb None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.320389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.335694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.336640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.337197 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.337710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.338637 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.339176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.340823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.355824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 67/124] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.356240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.356960 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.357250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.357529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.358288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:42.358684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.359370 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.360220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.371455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 58/125] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.372334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.445278 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.493044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac69b1de-55d2-4db7-bbd6-16aebdaae67a None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.547490 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ecc977-8532-46b6-a135-f37e27054892 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.548218 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.548834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.549120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.549398 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.564765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:42.573540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:42.575070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 59/126] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:42.576330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.616161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.618199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.618985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.619859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/7930508aa7a648b2940c5e4fcfe5b1be/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.624161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f70b5c49945444ba47db4a46d4848f5, user_id=7930508aa7a648b2940c5e4fcfe5b1be, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.626815 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.663441 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 68/127] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:42 2022] PUT /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/7930508aa7a648b2940c5e4fcfe5b1be/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:42.663441 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.758392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc23758-5acd-46f0-b61b-e8f28e9d743f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.789495 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.804747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:42.842775 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.843722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.844011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.844291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.846778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.848319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.850461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 60/128] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.850992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:42.904700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b38a6d-84f9-4e36-b15b-6b3676383e67 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:42.982608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:42.983987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:42.984263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:42.984970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:42.985799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:42.987293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:42.991595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 69/129] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:42.995901 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.045024 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e63ec-1487-4a12-86c8-03a78c39761f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.085985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.086617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.086907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.087252 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.088079 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:43.088389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.090006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.103463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 61/130] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.104248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.128325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7d43d-0928-450c-ae2a-d7fd5bcd9e03 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.148580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.174882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.179730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.181696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.182392 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.183115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.187538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.189637 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.192396 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 70/131] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:42 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.193513 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.253905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ecbf5-0747-4b98-b2eb-9500613b2954 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.324097 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702fb96-553b-4827-9014-c057b82e0ad9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.375756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.378743 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.379471 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.379996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.380589 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.382364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.382825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.383262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.389409 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.391479 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.392772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.394494 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 71/132] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.395319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.396108 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.398281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 62/133] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:43.408183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.475644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.558023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02ae342-4bcc-44da-8975-0852bdf2f15d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.602228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.605573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.606110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.606699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/a3979e4c2a5e4d198e1d5e640a715e94/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.610321 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f70b5c49945444ba47db4a46d4848f5, user_id=a3979e4c2a5e4d198e1d5e640a715e94, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.613024 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.653436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 72/134] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:43 2022] PUT /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/a3979e4c2a5e4d198e1d5e640a715e94/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:43.661378 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:43.695585 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95430d9d-6a83-4f92-b311-601bd96a38a7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.735537 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:43.796011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd1ded3-bf2b-4399-a615-078f1f37b23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:43.797132 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ded3-bf2b-4399-a615-078f1f37b23d None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.797426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ded3-bf2b-4399-a615-078f1f37b23d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.797705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1ded3-bf2b-4399-a615-078f1f37b23d None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/a3979e4c2a5e4d198e1d5e640a715e94/roles/dd47724fb39b480896a4a89456effdf6` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.804060 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ded3-bf2b-4399-a615-078f1f37b23d None admin] RBAC: Authorizing `identity:create_grant(project_id=7f70b5c49945444ba47db4a46d4848f5, user_id=a3979e4c2a5e4d198e1d5e640a715e94, role_id=dd47724fb39b480896a4a89456effdf6)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:43.806765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd1ded3-bf2b-4399-a615-078f1f37b23d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:43.841330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 63/135] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:43 2022] PUT /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/a3979e4c2a5e4d198e1d5e640a715e94/roles/dd47724fb39b480896a4a89456effdf6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:43.843748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aef08-9304-4398-9d5e-b743f65c6690 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.844043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aef08-9304-4398-9d5e-b743f65c6690 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.845789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403aef08-9304-4398-9d5e-b743f65c6690 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.849700 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 64/136] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:43 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:43.858999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:43.859364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:43.859820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:43.903791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:43.909771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:43.949359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e2fb1-a5fb-4deb-aee6-9ed5f6336be8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:43.990614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.076337 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.077875 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.078291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.078681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] PATH_INFO: `/v3/projects/5a82b57732074ac9a11489e6a2e55957` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.082264 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] RBAC: Authorizing `identity:get_project(project_id=5a82b57732074ac9a11489e6a2e55957)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.085046 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.087518 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 73/137] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:43 2022] GET /identity/v3/projects/5a82b57732074ac9a11489e6a2e55957 => generated 313 bytes in 433 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:44.097148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.105104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 65/138] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:43 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:44.161920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.316031 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aadc19-6be2-45c9-ab2a-dd6c4154d2ca None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.382799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.385174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.385174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.385174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] PATH_INFO: `/v3/projects/5a82b57732074ac9a11489e6a2e55957/users/a3979e4c2a5e4d198e1d5e640a715e94/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.386803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] RBAC: Authorizing `identity:create_grant(project_id=5a82b57732074ac9a11489e6a2e55957, user_id=a3979e4c2a5e4d198e1d5e640a715e94, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.388582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.390766 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e386e8-2f9a-4bc5-8dc1-ff861675a850 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.411791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.419725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 74/139] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:44 2022] PUT /identity/v3/projects/5a82b57732074ac9a11489e6a2e55957/users/a3979e4c2a5e4d198e1d5e640a715e94/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:44.468427 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c1afa7-e301-40da-ae34-9a989ed3828b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.469248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1afa7-e301-40da-ae34-9a989ed3828b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.469584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1afa7-e301-40da-ae34-9a989ed3828b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.469824 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c1afa7-e301-40da-ae34-9a989ed3828b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.476432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1afa7-e301-40da-ae34-9a989ed3828b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.478039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c1afa7-e301-40da-ae34-9a989ed3828b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.480603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 66/140] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:44 2022] GET /identity/v3/domains/default => generated 200 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:44.488927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:44.541892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:44.652528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700ff60f-8d0d-4400-ab64-2c8275d38748 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:44.718169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a975d9fb-a10e-472f-ae11-4975065df2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:44.718923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d9fb-a10e-472f-ae11-4975065df2c2 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:44.719370 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d9fb-a10e-472f-ae11-4975065df2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:44.719854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a975d9fb-a10e-472f-ae11-4975065df2c2 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:44.720704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975d9fb-a10e-472f-ae11-4975065df2c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:44.722225 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a975d9fb-a10e-472f-ae11-4975065df2c2 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:44.754335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 75/141] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:44 2022] POST /identity/v3/users => generated 284 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:45.029419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169b71a-5ffc-4734-b5c8-0b313d13b586 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.030191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169b71a-5ffc-4734-b5c8-0b313d13b586 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.030191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169b71a-5ffc-4734-b5c8-0b313d13b586 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.031799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 67/142] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:45 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:45.037160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.037455 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.037739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.062564 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:45.067873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:45.158796 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 76/143] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:45 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:45.210630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169b71a-5ffc-4734-b5c8-0b313d13b586 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.372348 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169b71a-5ffc-4734-b5c8-0b313d13b586 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.421794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.422902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.423359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.423882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.439428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:45.447955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:45.449866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:45.451172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 68/144] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:45.457597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.500389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.631984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffb910e-745d-4c96-b794-b49699e1433b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.693154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.694293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.694782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.695247 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.696702 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:45.697240 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.700104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.716382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 77/145] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:45.723524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:45.784849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:45.892953 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2805941a-e524-4823-a99c-a63ad36331e5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:45.954734 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:45.956297 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:45.956788 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:45.957271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] PATH_INFO: `/v3/users/a87806fc41e341d881ce56659092f1d5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:45.959559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] RBAC: Authorizing `identity:get_user(user_id=a87806fc41e341d881ce56659092f1d5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:45.962341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:45.965419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 69/146] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/users/a87806fc41e341d881ce56659092f1d5 => generated 290 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:45.974194 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.090565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.119446 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08678f6c-8af9-4159-8514-902894cb1d41 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.159107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023df3-fe0a-4efd-855f-f55550aab038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.160072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023df3-fe0a-4efd-855f-f55550aab038 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.160476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023df3-fe0a-4efd-855f-f55550aab038 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.160759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023df3-fe0a-4efd-855f-f55550aab038 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.162151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023df3-fe0a-4efd-855f-f55550aab038 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.164852 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023df3-fe0a-4efd-855f-f55550aab038 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.167266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 78/147] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:45 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:46.174186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.344418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade6456-5e0a-4345-a475-38549151abcf None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.347833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:46.391071 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24447f-18c3-4639-8a29-b418e13d4da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.392141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24447f-18c3-4639-8a29-b418e13d4da2 None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.392584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24447f-18c3-4639-8a29-b418e13d4da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.392883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24447f-18c3-4639-8a29-b418e13d4da2 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/a87806fc41e341d881ce56659092f1d5/roles/6e4fac15600a46c5a7c117d4507040eb` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.394986 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24447f-18c3-4639-8a29-b418e13d4da2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f70b5c49945444ba47db4a46d4848f5, user_id=a87806fc41e341d881ce56659092f1d5, role_id=6e4fac15600a46c5a7c117d4507040eb)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:46.396500 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24447f-18c3-4639-8a29-b418e13d4da2 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:46.414393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 70/148] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:46 2022] PUT /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5/users/a87806fc41e341d881ce56659092f1d5/roles/6e4fac15600a46c5a7c117d4507040eb => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:46.616141 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487b6d4-9503-4dbd-b9c9-d108a085b4f1 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.616519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487b6d4-9503-4dbd-b9c9-d108a085b4f1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.616689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487b6d4-9503-4dbd-b9c9-d108a085b4f1 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.618411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 79/149] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:46.624527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.624858 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.625087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.652713 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:46.653936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:46.742069 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 71/150] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:46.769775 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487b6d4-9503-4dbd-b9c9-d108a085b4f1 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:46.889811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487b6d4-9503-4dbd-b9c9-d108a085b4f1 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:46.927266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:46.928107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:46.928388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:46.928661 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:46.946788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:46.955574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:46.956559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:46.957324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 80/151] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:46.964284 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.061805 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.071846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164bd055-9461-4880-a32e-6ce425c4acdf None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.111896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.112582 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.112862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.113138 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.113970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:47.114481 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.116022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.126379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 72/152] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:46 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:47.132588 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.157729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.298961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52eb195-a687-466b-b871-b8eb2bac3c23 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.361833 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.363270 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.363819 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.364292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] PATH_INFO: `/v3/users/7930508aa7a648b2940c5e4fcfe5b1be` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.366435 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] RBAC: Authorizing `identity:get_user(user_id=7930508aa7a648b2940c5e4fcfe5b1be)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.369189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.372415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 81/153] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/users/7930508aa7a648b2940c5e4fcfe5b1be => generated 248 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:47.381256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.549634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33348daa-0ceb-4486-ad78-0f2159653aa4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.593998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.594677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.594958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.595234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.623849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.673745 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.675263 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:47.794239 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 73/154] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:47.802041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:47.909460 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:47.939499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653798e-1985-44ea-ba82-bc23b0512cfa None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:47.992886 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8fb10-b178-4442-8515-661d3aadaf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:47.993786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8fb10-b178-4442-8515-661d3aadaf7a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:47.994095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8fb10-b178-4442-8515-661d3aadaf7a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:47.994439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8fb10-b178-4442-8515-661d3aadaf7a None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:47.996400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8fb10-b178-4442-8515-661d3aadaf7a None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:47.998829 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8fb10-b178-4442-8515-661d3aadaf7a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.001714 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 82/155] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:47 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:48.009082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:48.095875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:48.143893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c0088-9d1d-4d7d-988c-b7dc66c801bd None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:48.187153 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:48.187788 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.188222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.188496 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.189368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=7930508aa7a648b2940c5e4fcfe5b1be) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:48.189687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:48.191255 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4037b327-c135-45ee-ba8c-707d6c68a7d8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:48.200374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 74/156] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:48 2022] GET /identity/v3/role_assignments?user.id=7930508aa7a648b2940c5e4fcfe5b1be&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 610 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:48.917622 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5802d1-d4c1-4177-b523-8f62a62839b9 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.918375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5802d1-d4c1-4177-b523-8f62a62839b9 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.918375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5802d1-d4c1-4177-b523-8f62a62839b9 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.919944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 83/157] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:48.928024 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd977b5-c1f4-40e9-aa75-ea9e187cb9c9 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:48.928844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd977b5-c1f4-40e9-aa75-ea9e187cb9c9 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:48.928844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd977b5-c1f4-40e9-aa75-ea9e187cb9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:48.967795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-3dd977b5-c1f4-40e9-aa75-ea9e187cb9c9 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:48.970154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-3dd977b5-c1f4-40e9-aa75-ea9e187cb9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:49.099970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 75/158] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:49.146584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5802d1-d4c1-4177-b523-8f62a62839b9 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.290208 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069d49-d2e8-4621-9687-6db95a48ed5e None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.291193 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069d49-d2e8-4621-9687-6db95a48ed5e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.291999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48069d49-d2e8-4621-9687-6db95a48ed5e None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.294895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 76/159] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:49 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:49.301320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.302313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.302963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.312895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5802d1-d4c1-4177-b523-8f62a62839b9 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.359456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:49.361022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:49.378701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.380049 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.380519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.380970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.407728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:49.418015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:49.419773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:49.421345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 84/160] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:49.434140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.466167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.514695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.584694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 77/161] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:49.629508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.648554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65aab60-3a78-4bce-85f8-dba7b5086c46 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.705355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.706480 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.706958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.707463 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.708434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:49.708928 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:49.710503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:49.727118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 85/162] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:49.733181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:49.866405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b848f9b6-76a3-4b89-ba0c-584ff794a125 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:49.927184 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:49.948142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95420172-ffd4-42ee-892a-8c0252763596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:49.949358 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95420172-ffd4-42ee-892a-8c0252763596 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:49.949538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95420172-ffd4-42ee-892a-8c0252763596 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:49.949818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95420172-ffd4-42ee-892a-8c0252763596 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:49.981366 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95420172-ffd4-42ee-892a-8c0252763596 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:50.002586 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cd2ff-11f0-4697-8db9-4046cc944e03 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-95420172-ffd4-42ee-892a-8c0252763596 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:50.003097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.004007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:50.004848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 78/163] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.006091 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c433-2b3d-4bd5-824e-3baf4ff95f89 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.006091 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c433-2b3d-4bd5-824e-3baf4ff95f89 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.006285 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8941c433-2b3d-4bd5-824e-3baf4ff95f89 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.007979 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 79/164] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:50.017600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c433-2b3d-4bd5-824e-3baf4ff95f89 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.056117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc425b47-90f9-4dfa-977e-b43ac5618b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.057044 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc425b47-90f9-4dfa-977e-b43ac5618b04 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.057322 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc425b47-90f9-4dfa-977e-b43ac5618b04 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.057596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc425b47-90f9-4dfa-977e-b43ac5618b04 None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.058990 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc425b47-90f9-4dfa-977e-b43ac5618b04 None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.061168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc425b47-90f9-4dfa-977e-b43ac5618b04 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.064156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 86/165] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:49 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:50.066098 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.066599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.066890 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.101560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:50.103216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:50.126694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.228245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 87/166] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:50 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:50.231241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.287977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8941c433-2b3d-4bd5-824e-3baf4ff95f89 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.391486 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.392191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.392488 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.392744 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.393543 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:50.393841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.395294 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.413937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 80/167] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:50.414662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.415966 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.465590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbcf75-b406-4bf7-ac0c-1f336166f85b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.532799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.533638 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.533961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.534279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.634274 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.638558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:50.640052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:50.641409 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f2bc13-3b24-41e7-ac97-a46454d590c3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.726540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:50.742433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a88e5c-65cc-46ba-913c-078124cc246f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.743773 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88e5c-65cc-46ba-913c-078124cc246f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.744368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88e5c-65cc-46ba-913c-078124cc246f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.744891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a88e5c-65cc-46ba-913c-078124cc246f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.770968 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 88/168] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:50.772267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.780507 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a88e5c-65cc-46ba-913c-078124cc246f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-86a88e5c-65cc-46ba-913c-078124cc246f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:50.797392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:50.798317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:50.799135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 81/169] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:50.800416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5010ad-2808-426b-8ff8-bf7d64addfe1 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.802163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5010ad-2808-426b-8ff8-bf7d64addfe1 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.802163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5010ad-2808-426b-8ff8-bf7d64addfe1 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:50.802380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 82/170] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:50.803146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5010ad-2808-426b-8ff8-bf7d64addfe1 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:50.907110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b23ad-7873-4069-9677-6e120a572910 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:50.996554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:50.997590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:50.997743 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:50.998004 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.001363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.004113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.006100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 89/171] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.009211 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.084835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.113047 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5010ad-2808-426b-8ff8-bf7d64addfe1 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.202771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc898-94a5-4d29-9071-cf7be6332c2b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.213025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c65215-d2b6-456e-8d49-54789abb6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.214054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65215-d2b6-456e-8d49-54789abb6c08 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.214431 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65215-d2b6-456e-8d49-54789abb6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.214779 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c65215-d2b6-456e-8d49-54789abb6c08 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.219549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65215-d2b6-456e-8d49-54789abb6c08 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.221420 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c65215-d2b6-456e-8d49-54789abb6c08 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.231759 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 83/172] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:50 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.233223 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.233615 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.233899 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.255292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.256333 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.256626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.256905 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.257751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.258066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.259547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.271472 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 90/173] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.272525 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:51.273922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:51.276735 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.303511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.360812 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 84/174] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:51.361607 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.412701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.418400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb10bb-b9ef-4adc-b0e2-36919a38a6dc None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.470679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca52190d-668f-4193-bd63-ec13c424291e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.471357 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52190d-668f-4193-bd63-ec13c424291e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.471674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52190d-668f-4193-bd63-ec13c424291e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.471952 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca52190d-668f-4193-bd63-ec13c424291e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.478241 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059c5686-c53c-4624-9741-00deebd92e36 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.519253 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.519992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.520266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.520534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.521386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=a3979e4c2a5e4d198e1d5e640a715e94) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:51.521696 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.523365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf6819-e123-45b9-bb1f-170993545eaf None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.532109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 85/175] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/role_assignments?user.id=a3979e4c2a5e4d198e1d5e640a715e94&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=51992cc8771e4114ab2620b57493b066 => generated 610 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.533464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837db68-a57c-4327-9724-30c27f621f81 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.533751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837db68-a57c-4327-9724-30c27f621f81 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.534029 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8837db68-a57c-4327-9724-30c27f621f81 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.535800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 86/176] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:51.536152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837db68-a57c-4327-9724-30c27f621f81 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.578309 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.582320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52190d-668f-4193-bd63-ec13c424291e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.585389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca52190d-668f-4193-bd63-ec13c424291e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.702561 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8837db68-a57c-4327-9724-30c27f621f81 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:51.751314 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.762668 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 91/177] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:51.763345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5142c-bafc-434d-a158-fdcaa0832582 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.763680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5142c-bafc-434d-a158-fdcaa0832582 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.763995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5142c-bafc-434d-a158-fdcaa0832582 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.765127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db984d-4621-45bd-bd34-866d9c7cc91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:51.765343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 92/178] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:51.768940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4305-6e9d-454d-ad54-36abdb1e1ade None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.768940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4305-6e9d-454d-ad54-36abdb1e1ade None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.768940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa4305-6e9d-454d-ad54-36abdb1e1ade None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.769250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db984d-4621-45bd-bd34-866d9c7cc91b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.769324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 93/179] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:51.769390 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db984d-4621-45bd-bd34-866d9c7cc91b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.769614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db984d-4621-45bd-bd34-866d9c7cc91b None admin] PATH_INFO: `/v3/users/24ab7ca4df7248e7969cba4f065ad69f` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.773926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4305-6e9d-454d-ad54-36abdb1e1ade None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.788986 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db984d-4621-45bd-bd34-866d9c7cc91b None admin] RBAC: Authorizing `identity:get_user(user_id=24ab7ca4df7248e7969cba4f065ad69f)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:51.791707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db984d-4621-45bd-bd34-866d9c7cc91b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:51.794809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 87/180] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/users/24ab7ca4df7248e7969cba4f065ad69f => generated 284 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:51.799466 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:51.800028 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:51.800696 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:51.835775 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:51.837179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:51.921494 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 88/181] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:51 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:51.924864 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:51.936873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:51.945278 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa4305-6e9d-454d-ad54-36abdb1e1ade None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.002013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f138f7-88df-4801-8d1a-c219e5b04158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.002931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f138f7-88df-4801-8d1a-c219e5b04158 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.003077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f138f7-88df-4801-8d1a-c219e5b04158 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.003274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f138f7-88df-4801-8d1a-c219e5b04158 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.015864 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f138f7-88df-4801-8d1a-c219e5b04158 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-a7f138f7-88df-4801-8d1a-c219e5b04158 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:52.024226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.025127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:52.025958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 94/182] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.026811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.027131 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.027379 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.048753 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:52.049983 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:52.058789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fcbb4e-5552-4191-a6ca-459d62d7dc8f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.099519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491dc80b-3d7f-4c05-a35a-92e5386dd5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.100397 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dc80b-3d7f-4c05-a35a-92e5386dd5bb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.100673 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dc80b-3d7f-4c05-a35a-92e5386dd5bb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.100942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491dc80b-3d7f-4c05-a35a-92e5386dd5bb None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.102301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dc80b-3d7f-4c05-a35a-92e5386dd5bb None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.104125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491dc80b-3d7f-4c05-a35a-92e5386dd5bb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.106017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 89/183] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:51 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.113499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809170-88eb-4a29-811c-23017962274e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.113499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809170-88eb-4a29-811c-23017962274e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.113499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d809170-88eb-4a29-811c-23017962274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.115311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.134908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 95/184] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:52.140903 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-3d809170-88eb-4a29-811c-23017962274e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:52.141155 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.141286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-3d809170-88eb-4a29-811c-23017962274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:52.229850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 90/185] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:52.243642 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809170-88eb-4a29-811c-23017962274e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.249013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.289912 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0821e78f-92e2-45b9-af2b-a430c281ff70 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.336786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.337776 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.338234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.338681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.370928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d809170-88eb-4a29-811c-23017962274e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.409365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.409868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.410161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.410438 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.424092 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:52.424345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.425807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:52.432502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.434262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 91/186] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.435841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.519479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.555126 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b91a2-4b55-401f-954e-029a24562693 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.559880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 96/187] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:52.560823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.597098 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.597766 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.598141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.598322 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.599073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:52.599369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.600789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.609283 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 92/188] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.610115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.677119 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.689425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a613d-f7a3-4a4d-8347-7e09dcd7d6b3 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.736037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.736692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.736973 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.737247 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.738087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] RBAC: Adding query filter params (role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=a3979e4c2a5e4d198e1d5e640a715e94) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:52.738394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.739870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.747033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 97/189] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/role_assignments?user.id=a3979e4c2a5e4d198e1d5e640a715e94&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=dd47724fb39b480896a4a89456effdf6 => generated 610 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.747380 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.778602 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b222ab-c0f1-40b4-8bf3-43bd587f9537 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.818829 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:52.835353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039858e3-435b-441d-bd59-04258a660787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.839314 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039858e3-435b-441d-bd59-04258a660787 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.839967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039858e3-435b-441d-bd59-04258a660787 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.840461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039858e3-435b-441d-bd59-04258a660787 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.858306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039858e3-435b-441d-bd59-04258a660787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-039858e3-435b-441d-bd59-04258a660787 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:52.868587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:52.869967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 93/190] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:52.878347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039858e3-435b-441d-bd59-04258a660787 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:52.918892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f254a-a492-4cde-9f48-3e71819d7165 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:52.968035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:52.969539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:52.969539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:52.969539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:52.971306 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:52.974159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:52.976608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 98/191] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/domains/default => generated 200 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:52.977855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.014784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.025706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039858e3-435b-441d-bd59-04258a660787 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.062451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.063118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.063419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.063736 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.064483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.064782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.066190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.076880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 94/192] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.080359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.122772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ac6d2-bcfd-4a1a-8043-420d669fea9b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.139424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.173443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.174325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.174607 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.174891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.176180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.177650 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.183444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 99/193] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:52 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.183444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.207026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd51366f-814b-47a1-852e-8395f434e302 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.248537 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.249416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.249693 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.249961 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] PATH_INFO: `/v3/users/a3979e4c2a5e4d198e1d5e640a715e94` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.251173 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] RBAC: Authorizing `identity:get_user(user_id=a3979e4c2a5e4d198e1d5e640a715e94)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.252742 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.254384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 95/194] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/users/a3979e4c2a5e4d198e1d5e640a715e94 => generated 276 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.255117 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.284222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.305807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3472ae99-a83e-4256-81b1-8591c3097a4e None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.346439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.346916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.347510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.347739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.348635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.348942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.350464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.359362 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 100/195] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.361369 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.381033 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04200a7a-7b8f-409f-8077-55837ddf8393 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.402016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.420125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.420800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.421082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.421356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.422075 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.423569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.457934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 96/196] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:53 2022] POST /identity/v3/users => generated 298 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:53.457934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.500121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec77e2a8-4192-46b0-9c1d-b57196cd7a18 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.565302 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.567075 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.567574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.568021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] PATH_INFO: `/v3/users/24ab7ca4df7248e7969cba4f065ad69f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.569983 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] RBAC: Authorizing `identity:get_user(user_id=24ab7ca4df7248e7969cba4f065ad69f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.572521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.575452 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 101/197] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/users/24ab7ca4df7248e7969cba4f065ad69f => generated 284 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.577005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.617343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.655405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699afec-0f8a-4548-bed3-e2831188f54e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.710488 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.711894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.712639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.712917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.713944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=24ab7ca4df7248e7969cba4f065ad69f) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:53.714260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.716366 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.723595 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 97/198] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/role_assignments?user.id=24ab7ca4df7248e7969cba4f065ad69f&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 260 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.724457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:53.728242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64393913-f1c0-4ff2-906b-bf410f343bb7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.800611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.808700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.810776 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.811368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.813036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.922481 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd22b8-f02e-4375-8c5b-5a548ef4d8e5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:53.923998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.927950 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.954965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:53.980374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:53.981784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:53.982288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:53.983003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] PATH_INFO: `/v3/users/a87806fc41e341d881ce56659092f1d5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:53.984663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] RBAC: Authorizing `identity:get_user(user_id=a87806fc41e341d881ce56659092f1d5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:53.986378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:53.989288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 98/199] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/users/a87806fc41e341d881ce56659092f1d5 => generated 290 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:53.990293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.073587 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 102/200] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:54.075689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.172065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8379c74-a04e-4e86-8a67-f0f0a459262f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.193269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.256630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.257769 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.258234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.258688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.283275 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0d95b-eaed-4313-8cde-6a6f67573cbd None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.331887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.367519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.369163 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.369956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.370711 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.418351 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.420813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.542745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.547255 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.674207 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 99/201] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:53 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 684 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:54.675421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.698169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.727367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 103/202] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 652 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:54.728060 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.757490 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.837038 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7b14-9b48-4065-8d5c-fe16fa10d0a6 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.872544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:54.873894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:54.874374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:54.874842 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] PATH_INFO: `/v3/projects/5a82b57732074ac9a11489e6a2e55957` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:54.876288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] RBAC: Authorizing `identity:get_project(project_id=5a82b57732074ac9a11489e6a2e55957)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:54.877961 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:54.879940 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 100/203] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/projects/5a82b57732074ac9a11489e6a2e55957 => generated 313 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:54.880896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:54.945499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1958c-c353-42d2-9a99-e6a82857d0f6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:54.959892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:54.984087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c617cbe-9143-413b-a498-36da7bc118ec None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.019606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.020832 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.021327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.021793 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.023219 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.024917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.027142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 101/204] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:55.032275 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:55.049562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.050580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.050783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.051041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.056110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.057573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.059291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 104/205] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:54 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:55.060260 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:55.138582 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de87af6-29e6-4253-9b00-487e180b8375 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.175074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.176568 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.177048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.177541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.178567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=5a82b57732074ac9a11489e6a2e55957, user.id=a3979e4c2a5e4d198e1d5e640a715e94) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:55.179106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.180830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.188044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 102/206] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:55 2022] GET /identity/v3/role_assignments?user.id=a3979e4c2a5e4d198e1d5e640a715e94&scope.project.id=5a82b57732074ac9a11489e6a2e55957&role.id=51992cc8771e4114ab2620b57493b066 => generated 610 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:55.189461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:55.211167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:55.268914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:55.287518 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72732281-950a-4aa9-a134-9a8e5995b977 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.330804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.331551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.331835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.332112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.332974 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] RBAC: Adding query filter params (role.id=6e4fac15600a46c5a7c117d4507040eb, scope.project.id=7f70b5c49945444ba47db4a46d4848f5, user.id=a87806fc41e341d881ce56659092f1d5) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:55.333284 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.334890 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd4e67a-5f23-4281-a5ab-bd02ca5293f8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.343519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 105/207] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:55 2022] GET /identity/v3/role_assignments?user.id=a87806fc41e341d881ce56659092f1d5&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=6e4fac15600a46c5a7c117d4507040eb => generated 610 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:55.360611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ac769-248c-4f7b-8572-f057c9008dc3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:55.402833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:55.403456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:55.404080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:55.404370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:55.405243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] RBAC: Adding query filter params (role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=24ab7ca4df7248e7969cba4f065ad69f) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:55.405553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:55.407071 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f28e30-77ef-4914-94f3-2a195e789662 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:55.413763 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 103/208] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:55 2022] GET /identity/v3/role_assignments?user.id=24ab7ca4df7248e7969cba4f065ad69f&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=dd47724fb39b480896a4a89456effdf6 => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:56.777414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f51075-36ab-4770-b268-a6eda29c5cf1 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.777987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f51075-36ab-4770-b268-a6eda29c5cf1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.778387 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f51075-36ab-4770-b268-a6eda29c5cf1 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.780994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 106/209] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:56.784786 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca7e6-12bf-4950-9cbf-f02c3e671a95 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.785246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca7e6-12bf-4950-9cbf-f02c3e671a95 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.785320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca7e6-12bf-4950-9cbf-f02c3e671a95 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.787518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 104/210] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:56 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:56.788542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.789265 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.789546 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.794774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:56.795035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:56.795270 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:56.817086 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:56.817086 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:56.820691 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:56.820847 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:56.896998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 105/211] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:56.914061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 107/212] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:05:56.924170 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:56.926400 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:56.943148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.034666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9eecc-aa81-41e7-ab7a-273242fdb924 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.038220 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.058429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865468ab-0748-4e77-9f56-f43680226a2c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.077096 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3dc4aa-e78b-4371-9cef-3d8666e000f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.078141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc4aa-e78b-4371-9cef-3d8666e000f0 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.078518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc4aa-e78b-4371-9cef-3d8666e000f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.078789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3dc4aa-e78b-4371-9cef-3d8666e000f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.089636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3dc4aa-e78b-4371-9cef-3d8666e000f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-cb3dc4aa-e78b-4371-9cef-3d8666e000f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:57.097618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:57.098741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:57.099649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 106/213] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:57.100315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28e4b-1a84-488e-8521-664320900938 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.100382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28e4b-1a84-488e-8521-664320900938 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.100637 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e28e4b-1a84-488e-8521-664320900938 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.101422 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824991fd-d09c-47c1-8856-1d8c0810ae96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.102133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 107/214] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:57.102535 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824991fd-d09c-47c1-8856-1d8c0810ae96 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.102830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824991fd-d09c-47c1-8856-1d8c0810ae96 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.103134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824991fd-d09c-47c1-8856-1d8c0810ae96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.105699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824991fd-d09c-47c1-8856-1d8c0810ae96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.105840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824991fd-d09c-47c1-8856-1d8c0810ae96 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.106996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e28e4b-1a84-488e-8521-664320900938 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.107604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 108/215] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:05:56 2022] GET /identity/v3/domains/default => generated 200 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:57.108778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.109061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.109337 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.135125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:57.136643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:57.177310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.225535 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 109/216] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:57 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:57.226379 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.254819 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e28e4b-1a84-488e-8521-664320900938 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.302368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.303045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.303609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.303822 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.304771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:57.305154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.306721 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.321994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 108/217] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:57.323326 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.346327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.371759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bdf335-c254-407f-b8c3-d03a5436665b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.431293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.432130 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.432409 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.432678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.433394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.434850 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.453306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9be5e7-7428-41ac-9d4f-8ef7827efd75 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.475918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 110/218] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:05:57 2022] POST /identity/v3/users => generated 298 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:05:57.475918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.499150 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.524222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.525058 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.525347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.525625 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.541778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:57.551963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:57.553087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:05:57.553959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 109/219] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:57.559595 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.636305 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67918e-2d73-4129-a82c-6819e4893073 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.686358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.687520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.687867 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.688150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] PATH_INFO: `/v3/users/24ab7ca4df7248e7969cba4f065ad69f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.690920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] RBAC: Authorizing `identity:get_user(user_id=24ab7ca4df7248e7969cba4f065ad69f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.691819 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.693557 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 111/220] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/users/24ab7ca4df7248e7969cba4f065ad69f => generated 284 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:57.697678 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcc442-7d48-46e3-8ad5-1f0c6b5bb91f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.700106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.706938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.745367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.746068 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.746349 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.746924 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.747510 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:57.748171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.750914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.759769 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 110/221] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:57.769605 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.828031 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:57.835801 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27129fc-089b-4c28-9243-2d4db2df8293 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.890394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.891953 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.892295 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.892579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.893993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.896121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.897209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14911af0-34c5-4996-bf7f-6cd9fa4d7ddb None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:57.898121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 112/222] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:57.906159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:57.949844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a9526-7094-4730-add5-eabed9e95816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:57.950733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9526-7094-4730-add5-eabed9e95816 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.951106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9526-7094-4730-add5-eabed9e95816 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.951490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a9526-7094-4730-add5-eabed9e95816 None admin] PATH_INFO: `/v3/users/0680ed2ef23b42ee984fb42aad0899c0` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.970061 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a9526-7094-4730-add5-eabed9e95816 None admin] RBAC: Authorizing `identity:get_user(user_id=0680ed2ef23b42ee984fb42aad0899c0)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:57.971879 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a9526-7094-4730-add5-eabed9e95816 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:57.973798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 111/223] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/users/0680ed2ef23b42ee984fb42aad0899c0 => generated 298 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:57.975232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e1290-b638-499f-b1ba-1f1d76cd3ea2 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:57.975719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e1290-b638-499f-b1ba-1f1d76cd3ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:57.976172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08e1290-b638-499f-b1ba-1f1d76cd3ea2 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:57.977716 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 112/224] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:05:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:05:57.982696 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e1290-b638-499f-b1ba-1f1d76cd3ea2 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.005765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.056191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaedc9dc-8609-49f1-bb5a-1a21931b3d6e None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.100394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80816842-77f2-4fd6-b003-eac2f6beead0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.101281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80816842-77f2-4fd6-b003-eac2f6beead0 None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.101746 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80816842-77f2-4fd6-b003-eac2f6beead0 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.102032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80816842-77f2-4fd6-b003-eac2f6beead0 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/24ab7ca4df7248e7969cba4f065ad69f/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.104979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80816842-77f2-4fd6-b003-eac2f6beead0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00c53df360c4f8d9b34db69653b5898, user_id=24ab7ca4df7248e7969cba4f065ad69f, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.106450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80816842-77f2-4fd6-b003-eac2f6beead0 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.123351 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 113/225] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:57 2022] PUT /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/24ab7ca4df7248e7969cba4f065ad69f/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:05:58.124835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.125153 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.125466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.146004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08e1290-b638-499f-b1ba-1f1d76cd3ea2 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.149665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:05:58.150771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.150923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:05:58.214664 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.215643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.216119 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.216604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.243479 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 114/226] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:05:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:05:58.266338 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.336603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.338153 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.341129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.385853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef092f75-eac3-4460-b22f-e8d0dcacd975 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.429479 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.431654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.431952 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.432234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.444591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:05:58.455168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:05:58.456415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:05:58.457445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:05:58.458783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 115/227] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:05:58.464444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.495817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 113/228] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:05:57 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:05:58.507658 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.514729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.569685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e8bd58-2ffd-44a5-aa54-789d59870a81 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.604975 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.605663 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.605947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.606220 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.607410 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:58.607410 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.607911 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.611976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.622325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 116/229] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:58.628530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.738951 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874c11-f927-46da-9ccf-4ad166b118e3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.743012 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d14773d-7b8c-43f6-be4d-c050ad173d1b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.780642 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.781825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.782218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.782596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] PATH_INFO: `/v3/users/24ab7ca4df7248e7969cba4f065ad69f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.784010 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] RBAC: Authorizing `identity:get_user(user_id=24ab7ca4df7248e7969cba4f065ad69f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.785592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.787562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 117/230] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/users/24ab7ca4df7248e7969cba4f065ad69f => generated 284 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:58.793224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.824599 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.826029 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.826524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.826904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.832176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.833698 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.835898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 114/231] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:05:58.842453 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:58.853550 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:58.903709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b38b89-d6c8-44fb-b4ee-a875e8e1c9a9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:58.941520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:58.942398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:58.942684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:58.942962 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:58.944367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:58.945938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:58.947727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 118/232] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:05:58.954365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:05:59.007083 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.062875 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81acee7-8b15-4765-9526-3d8ee5efb701 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.073190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f1502-ddbd-46f2-8ab7-e376a753dc7f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:05:59.085537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:05:59.101675 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95852e2-85fa-4b40-85b7-e50e4686a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.102647 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95852e2-85fa-4b40-85b7-e50e4686a8cf None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.102931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95852e2-85fa-4b40-85b7-e50e4686a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.103204 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95852e2-85fa-4b40-85b7-e50e4686a8cf None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/24ab7ca4df7248e7969cba4f065ad69f/roles/dd47724fb39b480896a4a89456effdf6` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.105669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95852e2-85fa-4b40-85b7-e50e4686a8cf None admin] RBAC: Authorizing `identity:create_grant(project_id=d00c53df360c4f8d9b34db69653b5898, user_id=24ab7ca4df7248e7969cba4f065ad69f, role_id=dd47724fb39b480896a4a89456effdf6)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.107260 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95852e2-85fa-4b40-85b7-e50e4686a8cf None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.126482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 119/233] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:05:58 2022] PUT /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/24ab7ca4df7248e7969cba4f065ad69f/roles/dd47724fb39b480896a4a89456effdf6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:05:59.144700 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:05:59.145395 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:05:59.145674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:05:59.145947 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:05:59.146809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=0680ed2ef23b42ee984fb42aad0899c0) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:05:59.147121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:05:59.148798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef4d48b-eee1-4620-93d0-9f33cbd68b37 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:05:59.160649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 115/234] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:05:58 2022] GET /identity/v3/role_assignments?user.id=0680ed2ef23b42ee984fb42aad0899c0&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=51992cc8771e4114ab2620b57493b066 => generated 260 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:00.609235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65f170-cd1b-4b9b-8c78-d91de6d13086 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.609811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65f170-cd1b-4b9b-8c78-d91de6d13086 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.610104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac65f170-cd1b-4b9b-8c78-d91de6d13086 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.612708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 120/235] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:00 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:00.632300 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90073f-8842-4450-91cf-7231835f0750 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.632933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90073f-8842-4450-91cf-7231835f0750 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.632933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90073f-8842-4450-91cf-7231835f0750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.659773 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-7b90073f-8842-4450-91cf-7231835f0750 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:00.660972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-7b90073f-8842-4450-91cf-7231835f0750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:00.767474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 116/236] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:00.780740 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3640-dc5c-4519-814f-1444564d9067 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.781372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3640-dc5c-4519-814f-1444564d9067 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.781918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3640-dc5c-4519-814f-1444564d9067 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.784355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 121/237] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:00 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:00.790735 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:00.791364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:00.791874 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:00.805471 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3640-dc5c-4519-814f-1444564d9067 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:00.832581 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:00.834588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:00.979505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3640-dc5c-4519-814f-1444564d9067 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:00.996691 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.015081 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 117/238] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:00 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:01.035300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.036470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.036942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.037400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.064496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:01.072947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:01.074180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:01.074991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:01.077476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 122/239] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:01.083511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.114000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.199783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.291894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260d99f-1029-4f36-a3da-1c5d2db4641f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.299468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1400d010-77c1-4227-84cc-a7bd146fca16 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.335029 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.335818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.336106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.336388 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.337231 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:01.337472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.338350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eaeb6d-36e0-4c8a-b45d-829c41f7db0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.338895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52742137-04e9-4802-bfa8-013dfc194874 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.339156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaeb6d-36e0-4c8a-b45d-829c41f7db0b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.339483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaeb6d-36e0-4c8a-b45d-829c41f7db0b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.339817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eaeb6d-36e0-4c8a-b45d-829c41f7db0b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.341114 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaeb6d-36e0-4c8a-b45d-829c41f7db0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.342711 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eaeb6d-36e0-4c8a-b45d-829c41f7db0b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.344840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 123/240] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/domains/default => generated 200 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:01.346734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd74d6-eaba-4d48-be6b-aa217392530a None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.347020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd74d6-eaba-4d48-be6b-aa217392530a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.347296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd74d6-eaba-4d48-be6b-aa217392530a None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.348972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 124/241] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:01.349923 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 118/242] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:01.355571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd74d6-eaba-4d48-be6b-aa217392530a None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.356505 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.356861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.357510 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.380608 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:01.381879 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:01.448838 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.458230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 119/243] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:01.459866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.485226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dd74d6-eaba-4d48-be6b-aa217392530a None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.501090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.536769 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.537669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.538281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.538789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.539980 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.542919 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.579976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 125/244] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:01 2022] POST /identity/v3/users => generated 294 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:06:01.581082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.590848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f2a4f9-6813-405e-9300-e0828df76470 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.635022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.637928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.638764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.639310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] PATH_INFO: `/v3/users/11d55993583c4ee29b582697bcb08480` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.655664 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] RBAC: Authorizing `identity:get_user(user_id=11d55993583c4ee29b582697bcb08480)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.657904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.660478 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 120/245] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/users/11d55993583c4ee29b582697bcb08480 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:01.666747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.702438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22d9827-5a9f-488f-816b-d5bc99099c11 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.742414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.743251 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.743695 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.744049 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.755934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:01.771427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:01.772440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:01.773256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 126/246] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:01.774582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:01.808750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:01.827266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70d8c8-d58c-4c25-b8fc-5b8d53b5da82 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.897787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306daa1-8445-4594-a394-5e924ca0bc25 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:01.913486 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefa784-4f15-4b0d-9b09-366618deebe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.914421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefa784-4f15-4b0d-9b09-366618deebe1 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.914776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefa784-4f15-4b0d-9b09-366618deebe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.915135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefa784-4f15-4b0d-9b09-366618deebe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.938658 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:01.939841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:01.940429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:01.940914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:01.941930 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:01.942510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:01.944248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:01.955182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 127/247] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:01.961459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.031493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefa784-4f15-4b0d-9b09-366618deebe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.032222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefa784-4f15-4b0d-9b09-366618deebe1 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.056564 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.077418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997f6a5-5473-48f4-9968-9ac1102a8dcb None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.123779 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.124117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a85c2-8e04-4b5c-8075-b2f64166f863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.125325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a85c2-8e04-4b5c-8075-b2f64166f863 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.126398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a85c2-8e04-4b5c-8075-b2f64166f863 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.126398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a85c2-8e04-4b5c-8075-b2f64166f863 None admin] PATH_INFO: `/v3/users/24ab7ca4df7248e7969cba4f065ad69f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.129131 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a85c2-8e04-4b5c-8075-b2f64166f863 None admin] RBAC: Authorizing `identity:get_user(user_id=24ab7ca4df7248e7969cba4f065ad69f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.130731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a85c2-8e04-4b5c-8075-b2f64166f863 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.133169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 128/248] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/users/24ab7ca4df7248e7969cba4f065ad69f => generated 284 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:02.134274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669d46-8c5c-4d24-8511-04cb7955b805 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.134565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669d46-8c5c-4d24-8511-04cb7955b805 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.134850 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44669d46-8c5c-4d24-8511-04cb7955b805 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.139759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 129/249] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:02.143811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669d46-8c5c-4d24-8511-04cb7955b805 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.193333 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 121/250] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:01 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:02.195353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.195806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.196258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.221666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:02.223150 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:02.313551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44669d46-8c5c-4d24-8511-04cb7955b805 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.315694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 122/251] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:02.316940 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.367841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.368453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.369004 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.369123 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.403840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.433597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.459750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.461653 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.468313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85035d14-750d-4ba6-8d9c-93f51870cbfc None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.518628 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabb55db-9db1-4d4f-a9d6-6cdca382dc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.519640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb55db-9db1-4d4f-a9d6-6cdca382dc3e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.519991 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb55db-9db1-4d4f-a9d6-6cdca382dc3e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.520358 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabb55db-9db1-4d4f-a9d6-6cdca382dc3e None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.521598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb55db-9db1-4d4f-a9d6-6cdca382dc3e None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.523806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabb55db-9db1-4d4f-a9d6-6cdca382dc3e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.527543 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 123/252] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.529089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5246727-ecfa-48b7-8179-d65b2785e6b6 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.529464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5246727-ecfa-48b7-8179-d65b2785e6b6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.529749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5246727-ecfa-48b7-8179-d65b2785e6b6 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.531313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 124/253] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:02.532214 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5246727-ecfa-48b7-8179-d65b2785e6b6 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.630634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 130/254] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:02.632116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.687194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5246727-ecfa-48b7-8179-d65b2785e6b6 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.716227 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.744216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662e0a1-945c-4678-9003-40715d3bd6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.745719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e0a1-945c-4678-9003-40715d3bd6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.746007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e0a1-945c-4678-9003-40715d3bd6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.746289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662e0a1-945c-4678-9003-40715d3bd6b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.761427 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662e0a1-945c-4678-9003-40715d3bd6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-1662e0a1-945c-4678-9003-40715d3bd6b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:02.773617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:02.775733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:02.777578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:02.782460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 125/255] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:02.782460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.782460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.782460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.787134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43074f76-d993-49ce-96af-9ceb93aa3b2a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:02.790430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:02.806145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:02.807943 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:02.844741 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:02.846061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:02.846585 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:02.847058 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:02.848198 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] RBAC: Adding query filter params (role.id=6e4fac15600a46c5a7c117d4507040eb, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=11d55993583c4ee29b582697bcb08480) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:02.849002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:02.851730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:02.860440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 131/256] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/role_assignments?user.id=11d55993583c4ee29b582697bcb08480&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=6e4fac15600a46c5a7c117d4507040eb => generated 260 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:02.861591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.963065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 126/257] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:02.963868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:02.997825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9b89d-600b-4e68-b38c-1870d456d6bc None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.035821 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.079126 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.079907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.080187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.080457 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.084247 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.085939 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.088114 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 132/258] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.089573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.171808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d68c8d-6188-460c-bdad-cb804fdaf45a None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.215878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.217086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.217870 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.218594 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.219640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:03.220137 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.221809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.223768 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.233185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 127/259] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:02 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.239449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.300104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8094f82b-fadb-46fc-bdeb-46d8810d2114 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.351725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.352783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.353237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.353649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.375007 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:03.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:03.384195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:03.385182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:03.386031 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 133/260] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:03.387681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.468145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b0620c-0d7e-4000-b299-8ae2353c518d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.492243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.533694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.534362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.534645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.534918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.535791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=24ab7ca4df7248e7969cba4f065ad69f) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:03.536103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.537638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.552261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 128/261] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/role_assignments?user.id=24ab7ca4df7248e7969cba4f065ad69f&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 610 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.553354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.603818 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9239ec5f-f437-4865-9fcb-180e979e250d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.684726 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:03.724812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.726376 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.726797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.727214 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] PATH_INFO: `/v3/users/24ab7ca4df7248e7969cba4f065ad69f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.734724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] RBAC: Authorizing `identity:get_user(user_id=24ab7ca4df7248e7969cba4f065ad69f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.736583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.738737 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 134/262] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/users/24ab7ca4df7248e7969cba4f065ad69f => generated 284 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.744921 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.762659 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b393b6-ace1-4d97-8de6-39730ea980a6 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.834692 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:03.835378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:03.835699 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:03.835971 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:03.836729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:03.837034 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:03.838436 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:03.853936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 129/263] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:03.862448 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:03.964419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c0d2e-1739-4c2d-8f08-efd9d6208c0e None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:03.997357 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.033721 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.034077 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093257c-85f3-48a2-9b37-75d882b440ca None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.034384 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.034661 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.034931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.074765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.099154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.100182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.100464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.100743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] PATH_INFO: `/v3/users/0680ed2ef23b42ee984fb42aad0899c0` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.104025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] RBAC: Authorizing `identity:get_user(user_id=0680ed2ef23b42ee984fb42aad0899c0)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.105521 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.114221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 130/264] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/users/0680ed2ef23b42ee984fb42aad0899c0 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:04.122461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.185585 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.187089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.362500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 135/265] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:03 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:04.366614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354628dd-36be-4819-a571-b280d2fb8471 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.369164 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.391559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.424719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.426288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.426876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.427293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.429405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.431899 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.435146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 131/266] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:04 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:04.443493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.530686 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.560701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdaa441-667f-4c3b-a062-a6d4d47a9f1c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.612420 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.613810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.613993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.614456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.617369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16be5232-d7e5-42da-aef7-cb2ca8435f8d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.620784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.622516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.624709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 136/267] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:04 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:04.631825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:04.656254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce8ff-bac7-4e43-ae5d-d18370ce8bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.657600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce8ff-bac7-4e43-ae5d-d18370ce8bde None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.658166 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce8ff-bac7-4e43-ae5d-d18370ce8bde None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.658653 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce8ff-bac7-4e43-ae5d-d18370ce8bde None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/0680ed2ef23b42ee984fb42aad0899c0/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.660977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ce8ff-bac7-4e43-ae5d-d18370ce8bde None admin] RBAC: Authorizing `identity:create_grant(project_id=d00c53df360c4f8d9b34db69653b5898, user_id=0680ed2ef23b42ee984fb42aad0899c0, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.662818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ce8ff-bac7-4e43-ae5d-d18370ce8bde None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.692526 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 132/268] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:04 2022] PUT /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/0680ed2ef23b42ee984fb42aad0899c0/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:04.786361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:04.838338 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c73eb43-2c32-4465-a359-7cd0df0c2dbb None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:04.904398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:04.905332 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:04.905748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:04.906168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:04.907626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] RBAC: Adding query filter params (role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=24ab7ca4df7248e7969cba4f065ad69f) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:04.908024 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:04.910373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab39cd3-eb13-484c-a925-d00e4ecfef03 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:04.925859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 137/269] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:04 2022] GET /identity/v3/role_assignments?user.id=24ab7ca4df7248e7969cba4f065ad69f&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=dd47724fb39b480896a4a89456effdf6 => generated 610 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:05.132572 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8bc5-4b54-485d-9447-5c7f4e405027 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.133633 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8bc5-4b54-485d-9447-5c7f4e405027 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.134303 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c8bc5-4b54-485d-9447-5c7f4e405027 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.136097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 133/270] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:05 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:05.143572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.144006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.144414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.170702 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:05.172250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:05.191639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0618da-ffe4-4492-938c-dde649f3335c None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.192141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0618da-ffe4-4492-938c-dde649f3335c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.192500 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0618da-ffe4-4492-938c-dde649f3335c None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.194138 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 134/271] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:05.201655 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.202047 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.202245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.232541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:05.233995 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:05.285906 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 138/272] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:05.313166 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.346785 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 135/273] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:05.399660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.448723 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.484043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.491292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a910db8-488d-4a47-839e-9c9628f9f535 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.544319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.545306 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.545707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.546617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.563463 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:05.568095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a715d-b20c-4c9e-a017-ba4b99a7264e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:05.577393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:05.579242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:05.580971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:05.587181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 139/274] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:05.589286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.652618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.658618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.659534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.660237 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.662767 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.665527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.668561 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 136/275] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/domains/default => generated 200 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:05.679555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.724731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846a38f-74ac-4e3e-809b-62b07ebac481 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.774601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.775954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.776382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.777007 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.778609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:05.779077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.780990 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.785284 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.796139 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 140/276] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:05.804605 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:05.836115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a9a86-295f-46b7-aa3c-3037fdb2602d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.859122 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:05.885424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647eec8c-92ce-4451-859d-ee24364daea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:05.886405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eec8c-92ce-4451-859d-ee24364daea6 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.886704 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eec8c-92ce-4451-859d-ee24364daea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.886989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647eec8c-92ce-4451-859d-ee24364daea6 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.888371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647eec8c-92ce-4451-859d-ee24364daea6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:05.890796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647eec8c-92ce-4451-859d-ee24364daea6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:05.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 137/277] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:05 2022] POST /identity/v3/users => generated 294 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:05.955487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953c8d-2e6f-4f4a-93bc-37fdb8739dbe None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:05.988271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56af81-ea75-4391-b9ca-6f738980e6b3 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.988452 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56af81-ea75-4391-b9ca-6f738980e6b3 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.988934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56af81-ea75-4391-b9ca-6f738980e6b3 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:05.991098 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 138/278] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:05 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:05.997672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:05.998011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:05.998239 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.002059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.003108 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.003311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.003661 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] PATH_INFO: `/v3/users/562853071ec547ca893a4b704d23d3a0` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.018512 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:06.019771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:06.020397 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] RBAC: Authorizing `identity:get_user(user_id=562853071ec547ca893a4b704d23d3a0)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.022103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.024595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 141/279] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:05 2022] GET /identity/v3/users/562853071ec547ca893a4b704d23d3a0 => generated 294 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.030941 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.113041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.114108 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 139/280] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:05 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:06.139317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.171740 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c658be9-723a-4d5f-97c7-9600d08ebd75 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.225868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.226675 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.226973 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.227252 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.228180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, user.id=562853071ec547ca893a4b704d23d3a0, scope.system=all) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:06.228499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.230113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.236471 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 142/281] 10.222.0.112 () {56 vars in 1313 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/role_assignments?user.id=562853071ec547ca893a4b704d23d3a0&scope.system=all&role.id=51992cc8771e4114ab2620b57493b066 => generated 227 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:06.300011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788ea72-74b4-43b7-8b6a-a08d0e6eb098 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.302023 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.369756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.372833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.372833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.372833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.390052 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:06.398197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:06.399911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:06.401362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 140/282] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:06.406002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.539804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a039a-1ac0-4904-b2db-cd9603b7ca14 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.565892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:06.590199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.591029 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.591371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.591766 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.592846 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:06.593259 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.594761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.605143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 143/283] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.612789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:06.831531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b3579-8488-4eea-9509-9c27e4ff9078 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:06.897733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:06.898647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:06.898936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:06.899218 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] PATH_INFO: `/v3/users/11d55993583c4ee29b582697bcb08480` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:06.900793 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] RBAC: Authorizing `identity:get_user(user_id=11d55993583c4ee29b582697bcb08480)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:06.902299 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:06.905555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 141/284] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/users/11d55993583c4ee29b582697bcb08480 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:06.910691 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.080242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138276b5-5e32-486e-ad11-dae05385e3bc None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.133704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5edab72-0c88-4c3d-8ec3-fa526a7a038e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.134506 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edab72-0c88-4c3d-8ec3-fa526a7a038e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.134781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edab72-0c88-4c3d-8ec3-fa526a7a038e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.135052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5edab72-0c88-4c3d-8ec3-fa526a7a038e None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.136307 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edab72-0c88-4c3d-8ec3-fa526a7a038e None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.138044 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5edab72-0c88-4c3d-8ec3-fa526a7a038e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.140534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 144/285] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:06 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:07.147991 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.213896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.335977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b8bce-8fda-4b58-b033-076977e1c682 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.400770 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15288e3f-8cb8-4d32-a17e-bf2ce9210426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.401794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288e3f-8cb8-4d32-a17e-bf2ce9210426 None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.402108 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288e3f-8cb8-4d32-a17e-bf2ce9210426 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.402360 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15288e3f-8cb8-4d32-a17e-bf2ce9210426 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/11d55993583c4ee29b582697bcb08480/roles/6e4fac15600a46c5a7c117d4507040eb` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.409225 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15288e3f-8cb8-4d32-a17e-bf2ce9210426 None admin] RBAC: Authorizing `identity:create_grant(project_id=d00c53df360c4f8d9b34db69653b5898, user_id=11d55993583c4ee29b582697bcb08480, role_id=6e4fac15600a46c5a7c117d4507040eb)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:07.410782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15288e3f-8cb8-4d32-a17e-bf2ce9210426 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:07.434184 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 142/286] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:07 2022] PUT /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898/users/11d55993583c4ee29b582697bcb08480/roles/6e4fac15600a46c5a7c117d4507040eb => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:07.571717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05075-d819-4cb4-96fa-1c60e0828083 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.571717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05075-d819-4cb4-96fa-1c60e0828083 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.571717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d05075-d819-4cb4-96fa-1c60e0828083 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.572351 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 145/287] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:07.578539 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.578879 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.579204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:07.613412 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:07.614611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:07.741219 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 143/288] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:07 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:07.776918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d05075-d819-4cb4-96fa-1c60e0828083 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:07.865630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:07.939019 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d05075-d819-4cb4-96fa-1c60e0828083 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:07.985127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:07.985951 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:07.986234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:07.986510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.000695 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:08.009643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:08.010589 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:08.011443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 146/289] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:08.020638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.078755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.210862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d53d1-b60c-4861-a591-676a9f585567 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.267066 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.267765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.268075 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.268360 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.271366 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:08.271725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.273281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.284738 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 144/290] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:08.291356 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.433693 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3f3e2d-9c4d-4172-bcd1-93cdd94a15e2 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.452307 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.489090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.490238 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.490659 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.491009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] PATH_INFO: `/v3/users/0680ed2ef23b42ee984fb42aad0899c0` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.492726 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] RBAC: Authorizing `identity:get_user(user_id=0680ed2ef23b42ee984fb42aad0899c0)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.494480 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:08.496729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 147/291] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/users/0680ed2ef23b42ee984fb42aad0899c0 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:08.505237 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:08.659794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:08.692200 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced01bbf-0df5-42e1-ac71-eff266e5dfc6 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:08.765930 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:08.766801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:08.767211 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:08.767661 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:08.909114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:08.910748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.037568 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.053344 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 145/292] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:08 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:09.064537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.324241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790d3316-b9c9-4344-9c4d-bda96e650af2 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.399487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695fdc9-8b98-4acb-8d18-ee2eb1da5af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.401194 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695fdc9-8b98-4acb-8d18-ee2eb1da5af9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.401703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695fdc9-8b98-4acb-8d18-ee2eb1da5af9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.402213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695fdc9-8b98-4acb-8d18-ee2eb1da5af9 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.404728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695fdc9-8b98-4acb-8d18-ee2eb1da5af9 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.407685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695fdc9-8b98-4acb-8d18-ee2eb1da5af9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.411039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 148/293] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:09.418407 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.519843 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac05e-4be3-4aa2-b9d2-6edb99bd7675 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.520379 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac05e-4be3-4aa2-b9d2-6edb99bd7675 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.520891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cac05e-4be3-4aa2-b9d2-6edb99bd7675 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.524008 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 149/294] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:09 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:09.531673 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0101-3a1d-488a-86a7-b63e17b0fe5d None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.532220 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0101-3a1d-488a-86a7-b63e17b0fe5d None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.532743 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0101-3a1d-488a-86a7-b63e17b0fe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.573889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-d5ca0101-3a1d-488a-86a7-b63e17b0fe5d None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:09.578794 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d5ca0101-3a1d-488a-86a7-b63e17b0fe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:09.632346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc15b2-dfbd-4e77-8b2b-9e12f116f9f2 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:09.641404 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.676134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 150/295] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:09.678728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859097d9-b70f-4164-b307-b38da202d493 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.679258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859097d9-b70f-4164-b307-b38da202d493 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.680068 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859097d9-b70f-4164-b307-b38da202d493 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.681710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 151/296] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:09 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:09.683701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c005-447f-4a25-8fe1-609560716499 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.684236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c005-447f-4a25-8fe1-609560716499 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.684714 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f453c005-447f-4a25-8fe1-609560716499 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.691196 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 152/297] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:09 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:09.693272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.694356 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.694854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.716818 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:09.718334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:09.719025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.719185 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:09.719289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.719591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.720569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=0680ed2ef23b42ee984fb42aad0899c0) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:09.720888 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:09.722565 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb193fe-bc77-4486-8726-75d6bf70d829 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:09.731955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 146/298] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/role_assignments?user.id=0680ed2ef23b42ee984fb42aad0899c0&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=51992cc8771e4114ab2620b57493b066 => generated 610 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:09.733507 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:09.733870 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:09.734246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:09.764812 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:09.766037 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:09.855900 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 153/299] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:09.867438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:09.898874 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:09.951707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 147/300] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:09 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:09.953623 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.086725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39bd77-f8e2-41bc-b369-8b53dc1c8e63 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.101697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.154423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb44b93-3355-4aaf-af64-336c3015adc3 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.159157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.160095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.160456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.160922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.179317 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:10.187434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:10.189427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 154/301] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:10.190291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.221179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.221967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.222248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.222578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.236292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:10.244226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:10.245145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 148/302] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:10.246370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.289247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.326472 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327615bc-e763-4c19-b8d0-c16d610e5009 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.363245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656054-a8d4-4b75-8de8-3d4c705aca4a None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.367006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.369670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.369959 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.370235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.375430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.375430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.377181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 155/303] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/domains/default => generated 200 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.377181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.412774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.413744 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.414031 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.414312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.415068 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:10.415379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.416809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.422691 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.428989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 149/304] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.429661 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.504665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3340ee-f577-4d12-8af2-09650b3a9275 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.551156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.552034 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.552539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.552981 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.554031 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:10.554341 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.555795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.574695 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 156/305] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.574695 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.574955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.578139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d17ed-c3c2-446f-9cc2-23d577a97b51 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.629401 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.630129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.630451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.630738 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] PATH_INFO: `/v3/groups` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.631467 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.632989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.651277 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 150/306] 10.222.0.112 () {60 vars in 1139 bytes} [Mon Jul 25 19:06:10 2022] POST /identity/v3/groups => generated 230 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:10.652403 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.736329 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.751189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4a048b-558e-49fe-80ce-d1c3936d4d43 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.797781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adb0aab-6ba5-4d84-a085-6be818062a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.798835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb0aab-6ba5-4d84-a085-6be818062a2c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.799175 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb0aab-6ba5-4d84-a085-6be818062a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.799473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adb0aab-6ba5-4d84-a085-6be818062a2c None admin] PATH_INFO: `/v3/users/562853071ec547ca893a4b704d23d3a0` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.800825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb0aab-6ba5-4d84-a085-6be818062a2c None admin] RBAC: Authorizing `identity:get_user(user_id=562853071ec547ca893a4b704d23d3a0)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.802324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adb0aab-6ba5-4d84-a085-6be818062a2c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.808353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 157/307] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/users/562853071ec547ca893a4b704d23d3a0 => generated 294 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.808353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde45d2-c38e-40f7-b5e8-85967923ff52 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.808353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde45d2-c38e-40f7-b5e8-85967923ff52 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.808353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde45d2-c38e-40f7-b5e8-85967923ff52 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.808353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 158/308] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:10 2022] GET /identity => generated 271 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:10.815235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde45d2-c38e-40f7-b5e8-85967923ff52 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:10.819624 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c640f6e-28d5-44a5-96af-182d9780dd38 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:10.875263 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c376ae-b166-4d5a-bb70-e761639c01f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:10.876214 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c376ae-b166-4d5a-bb70-e761639c01f3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.876497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c376ae-b166-4d5a-bb70-e761639c01f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.876771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c376ae-b166-4d5a-bb70-e761639c01f3 None admin] PATH_INFO: `/v3/users/1b17c8e2b19d4cb9aeb1825acdc66516` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.906503 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c376ae-b166-4d5a-bb70-e761639c01f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1b17c8e2b19d4cb9aeb1825acdc66516)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:10.909191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c376ae-b166-4d5a-bb70-e761639c01f3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:10.909763 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 151/309] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:10 2022] GET /identity/v3/users/1b17c8e2b19d4cb9aeb1825acdc66516 => generated 294 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:10.911173 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:10.911491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:10.911842 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:10.933285 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:10.934595 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:10.948491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:10.979562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde45d2-c38e-40f7-b5e8-85967923ff52 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.029314 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 152/310] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:10 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:11.030573 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.042505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.043533 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.043881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.044223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] PATH_INFO: `/v3/system/users/562853071ec547ca893a4b704d23d3a0/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.045892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=562853071ec547ca893a4b704d23d3a0, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.047706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.059151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 159/311] 10.222.0.112 () {58 vars in 1339 bytes} [Mon Jul 25 19:06:10 2022] PUT /identity/v3/system/users/562853071ec547ca893a4b704d23d3a0/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:11.064501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.106152 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.207020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333e447-72ff-47bc-a42c-baca54308e8f None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.255038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.256521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.256903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.257275 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.276462 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:11.286873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:11.288375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:11.289597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:11.291363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 160/312] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:11.295523 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.324234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6994c7f4-3529-4545-bcaa-c822729ca3c7 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.372958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.374097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.374592 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.375120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.376249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] RBAC: Adding query filter params (role.id=6e4fac15600a46c5a7c117d4507040eb, user.id=1b17c8e2b19d4cb9aeb1825acdc66516, scope.system=all) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:11.376791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.378649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.384963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 153/313] 10.222.0.112 () {56 vars in 1313 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/role_assignments?user.id=1b17c8e2b19d4cb9aeb1825acdc66516&scope.system=all&role.id=6e4fac15600a46c5a7c117d4507040eb => generated 227 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:11.411931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.420184 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1c2704-0505-419a-9e0f-281770774b7b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.468087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.468863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.469298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.469633 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.470710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:11.471111 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.473102 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.493933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 161/314] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:11.495515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.535510 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.608985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03a924-6e4f-469d-95a7-c6a37e7b0f46 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.645137 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.646067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.646334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.646611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] PATH_INFO: `/v3/users/11d55993583c4ee29b582697bcb08480` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.647862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] RBAC: Authorizing `identity:get_user(user_id=11d55993583c4ee29b582697bcb08480)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.649324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.651168 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 154/315] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/users/11d55993583c4ee29b582697bcb08480 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:11.657293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:11.766846 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4412c9b-988f-4b7b-a898-4a294f03d733 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:11.803609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:11.804261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:11.804544 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:11.804823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:11.829917 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:11.880562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:11.882051 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:11.994898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 162/316] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:12.000575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:12.086133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:12.113861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619a312-fd9b-4032-be6a-634a2d60893c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:12.162491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856315e-ab02-4d76-8583-a76cafdf8195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:12.163648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856315e-ab02-4d76-8583-a76cafdf8195 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.164108 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856315e-ab02-4d76-8583-a76cafdf8195 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.164526 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856315e-ab02-4d76-8583-a76cafdf8195 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.165877 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856315e-ab02-4d76-8583-a76cafdf8195 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:12.167524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856315e-ab02-4d76-8583-a76cafdf8195 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:12.174969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 155/317] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:11 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:12.177219 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:12.253402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:12.312457 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9cdd71-e5e6-4805-9ea7-b4e46c2377d9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:12.367327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:12.368652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:12.369171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:12.369608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:12.370682 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] RBAC: Adding query filter params (role.id=6e4fac15600a46c5a7c117d4507040eb, scope.project.id=d00c53df360c4f8d9b34db69653b5898, user.id=11d55993583c4ee29b582697bcb08480) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:12.371367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:12.373794 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a89440d-ba94-40fa-8ed6-515a7c727425 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:12.387613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 163/318] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:12 2022] GET /identity/v3/role_assignments?user.id=11d55993583c4ee29b582697bcb08480&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=6e4fac15600a46c5a7c117d4507040eb => generated 610 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:13.189524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2492-3edb-4b56-a850-177c0bb6fc9a None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.190032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2492-3edb-4b56-a850-177c0bb6fc9a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.190032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14b2492-3edb-4b56-a850-177c0bb6fc9a None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.191588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 156/319] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:13.196861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.197571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.197774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.221296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:13.222826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:13.304919 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 164/320] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:13.329639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b2492-3edb-4b56-a850-177c0bb6fc9a None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.470533 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14b2492-3edb-4b56-a850-177c0bb6fc9a None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.508646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bf6510-9820-468f-b5cd-d75f4866517a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.509507 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6510-9820-468f-b5cd-d75f4866517a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.509826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6510-9820-468f-b5cd-d75f4866517a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.510110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf6510-9820-468f-b5cd-d75f4866517a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.511483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6510-9820-468f-b5cd-d75f4866517a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.512952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bf6510-9820-468f-b5cd-d75f4866517a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.515263 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 157/321] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/domains/default => generated 200 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:13.522212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.527121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767e0cb-c14c-4292-8bca-911204d82648 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.527432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767e0cb-c14c-4292-8bca-911204d82648 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.527715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5767e0cb-c14c-4292-8bca-911204d82648 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.529317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 158/322] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:13.534534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.534820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.535095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.556041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:13.556041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:13.567417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.593024 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.649575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 159/323] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:13.660328 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be63dcb2-f61b-4dd4-ba33-d6a811ed45d8 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.675227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.705476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3209de-8051-49d1-9ed5-1833078fdf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.706144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3209de-8051-49d1-9ed5-1833078fdf28 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.706458 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3209de-8051-49d1-9ed5-1833078fdf28 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.706718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3209de-8051-49d1-9ed5-1833078fdf28 None admin] PATH_INFO: `/v3/groups` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.707425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3209de-8051-49d1-9ed5-1833078fdf28 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:13.709218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3209de-8051-49d1-9ed5-1833078fdf28 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:13.735948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 165/324] 10.222.0.112 () {60 vars in 1139 bytes} [Mon Jul 25 19:06:13 2022] POST /identity/v3/groups => generated 227 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:06:13.769555 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e46a-f76a-4dc4-9dde-51b90a9e5274 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.769855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e46a-f76a-4dc4-9dde-51b90a9e5274 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.770159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e46a-f76a-4dc4-9dde-51b90a9e5274 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.773148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 166/325] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:13 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:13.778827 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.779377 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.779377 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.802499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:13.804279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:13.822506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2641c70d-12ed-493c-a8b7-ff0fcffb36b1 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:13.877775 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:13.879495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:13.879950 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:13.880489 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:13.899012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:13.906944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 167/326] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:13 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:13.910867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:13.912254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:13.921059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 160/327] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:13.923551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.934472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:13.939012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:13.971629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.065965 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80fec9d-088d-4bc0-bb2a-6571c083e9b7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.066763 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ecf40-e143-4d45-b5bd-3bf6f1f5cdc3 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.115071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.115850 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.116134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.116407 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.117264 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.117568 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.118385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.118985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.119670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.120035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.120457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.130614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 168/328] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.136480 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:14.137636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:14.144746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:14.146130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:14.147540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 161/329] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:14.152505 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.244683 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.311540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.316088 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2209cd-b7b6-4c39-9316-80037df265dc None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.327788 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226f5b4-eeb7-4fce-8530-e7e1e6083550 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.357466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.358366 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.358647 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.358917 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] PATH_INFO: `/v3/users/562853071ec547ca893a4b704d23d3a0` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.360172 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] RBAC: Authorizing `identity:get_user(user_id=562853071ec547ca893a4b704d23d3a0)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.361621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.363252 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 169/330] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/users/562853071ec547ca893a4b704d23d3a0 => generated 294 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.371153 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.376096 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.377135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.377622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.378099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.379059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.379597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.381762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.393948 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 162/331] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.402103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.497918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b812c526-b941-4dac-be35-e7f49a2e0f80 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.550091 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.550777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.551058 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.551333 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.552258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] RBAC: Adding query filter params (role.id=51992cc8771e4114ab2620b57493b066, user.id=562853071ec547ca893a4b704d23d3a0, scope.system=all) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:14.552574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.554047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.574922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 170/332] 10.222.0.112 () {56 vars in 1313 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/role_assignments?user.id=562853071ec547ca893a4b704d23d3a0&scope.system=all&role.id=51992cc8771e4114ab2620b57493b066 => generated 512 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.594172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395de11b-d8e1-49e5-a016-ac4ed1170d6f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.628740 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.646286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67272ebd-3ed2-4321-82bb-ccc0e3059569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.647206 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67272ebd-3ed2-4321-82bb-ccc0e3059569 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.647519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67272ebd-3ed2-4321-82bb-ccc0e3059569 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.647801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67272ebd-3ed2-4321-82bb-ccc0e3059569 None admin] PATH_INFO: `/v3/users/1b17c8e2b19d4cb9aeb1825acdc66516` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.649107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67272ebd-3ed2-4321-82bb-ccc0e3059569 None admin] RBAC: Authorizing `identity:get_user(user_id=1b17c8e2b19d4cb9aeb1825acdc66516)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.650616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67272ebd-3ed2-4321-82bb-ccc0e3059569 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.652405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 163/333] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:14 2022] GET /identity/v3/users/1b17c8e2b19d4cb9aeb1825acdc66516 => generated 294 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:14.658343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:14.712429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:14.839679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cafe60-7205-4149-90da-a1bb5f07ffda None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:14.892755 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175536e-843b-44d5-9d86-ac76441bfaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:14.894926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175536e-843b-44d5-9d86-ac76441bfaef None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:14.895866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175536e-843b-44d5-9d86-ac76441bfaef None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:14.896650 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175536e-843b-44d5-9d86-ac76441bfaef None admin] PATH_INFO: `/v3/system/users/1b17c8e2b19d4cb9aeb1825acdc66516/roles/6e4fac15600a46c5a7c117d4507040eb` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:14.903054 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175536e-843b-44d5-9d86-ac76441bfaef None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1b17c8e2b19d4cb9aeb1825acdc66516, role_id=6e4fac15600a46c5a7c117d4507040eb)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:14.905843 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8175536e-843b-44d5-9d86-ac76441bfaef None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:14.921397 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 171/334] 10.222.0.112 () {58 vars in 1339 bytes} [Mon Jul 25 19:06:14 2022] PUT /identity/v3/system/users/1b17c8e2b19d4cb9aeb1825acdc66516/roles/6e4fac15600a46c5a7c117d4507040eb => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:16.907677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59d91-096e-4984-9088-9dcfc8a537f3 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.908202 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59d91-096e-4984-9088-9dcfc8a537f3 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.908202 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d59d91-096e-4984-9088-9dcfc8a537f3 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.909849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 164/335] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:16.915685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:16.916123 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:16.916271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:16.944692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:16.946134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:17.045987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 172/336] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:16 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:17.091749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59d91-096e-4984-9088-9dcfc8a537f3 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:17.225052 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d59d91-096e-4984-9088-9dcfc8a537f3 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:17.265066 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:17.265913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.266225 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.266706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.283551 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:17.291776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:17.292674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:17.293532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:17.294638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 165/337] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:17.300876 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:17.334082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:17.483682 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981bf1bb-a78e-4119-8a79-a3d108006d6e None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:17.533338 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:17.534519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.535002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.535494 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.536542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:17.537045 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:17.538688 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e102c5a-e026-4e3b-ba4c-fa9a78c8799c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:17.551739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 173/338] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:17 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:17.558046 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:17.635981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:17.642135 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dc2c-87f7-4abc-9595-e513ae76d49b None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.642798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dc2c-87f7-4abc-9595-e513ae76d49b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.643266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2dc2c-87f7-4abc-9595-e513ae76d49b None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.644856 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 174/339] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:17.650848 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7576f-ff55-4207-857b-e9c5e0d8a273 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.651663 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7576f-ff55-4207-857b-e9c5e0d8a273 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.652308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7576f-ff55-4207-857b-e9c5e0d8a273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.687430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-97d7576f-ff55-4207-857b-e9c5e0d8a273 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:17.688972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-97d7576f-ff55-4207-857b-e9c5e0d8a273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:17.703380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04952e76-cd25-47b0-9824-dec659d00cfd None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:17.764282 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:17.764873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.767411 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.767411 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.826106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 175/340] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:17.827254 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598d2f1-2980-471c-af2b-65eed6342f5a None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.827582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598d2f1-2980-471c-af2b-65eed6342f5a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.827861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d598d2f1-2980-471c-af2b-65eed6342f5a None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.833566 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 176/341] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:17.836269 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:17.836584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:17.836824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:17.875660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:17.877246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:17.881789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:17.881976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:17.887744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.000003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.014127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 177/342] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:17 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:18.015206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.067459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 166/343] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:17 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:18.068800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.221154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddba097-c608-4e97-8050-b147c3fedb0b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.237424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0239f73-6368-4a20-83e6-da5e0236b676 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.269825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.270918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.271335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.272603 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.285478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:18.294201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:18.295187 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:18.296032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:18.298921 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 178/344] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:18.304610 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.305177 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.327987 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.330531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.330531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.330531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.346961 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:18.358695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:18.359707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 167/345] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:18.360927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.381833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.436134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0ba1e9-bdc8-4bca-8e60-0df2c5ea42df None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.472370 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3298b-5ae3-4872-8c73-f35a8784ef27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.473275 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3298b-5ae3-4872-8c73-f35a8784ef27 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.473689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3298b-5ae3-4872-8c73-f35a8784ef27 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.474175 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3298b-5ae3-4872-8c73-f35a8784ef27 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.476497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3298b-5ae3-4872-8c73-f35a8784ef27 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.477942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e3298b-5ae3-4872-8c73-f35a8784ef27 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.481241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 179/346] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.481668 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ec95-3480-4579-bb60-5c1d0a0a81ff None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.481958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ec95-3480-4579-bb60-5c1d0a0a81ff None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.482239 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0234ec95-3480-4579-bb60-5c1d0a0a81ff None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.483516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 180/347] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:18.484212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234ec95-3480-4579-bb60-5c1d0a0a81ff None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.490382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cfd12-abfc-4959-aa43-78b09456f571 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.533066 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.533781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.534067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.535059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.535168 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:18.535426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.536964 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8f32f-7691-45e2-8b35-41ab738ef297 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.546901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 168/348] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.548432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88a853-11d9-4fd0-b931-1b967fdfaf9f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.548727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88a853-11d9-4fd0-b931-1b967fdfaf9f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.549004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88a853-11d9-4fd0-b931-1b967fdfaf9f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.550419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 169/349] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:18 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:18.552058 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88a853-11d9-4fd0-b931-1b967fdfaf9f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.581918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.628343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0234ec95-3480-4579-bb60-5c1d0a0a81ff None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.660087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:18.675704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.676861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.677146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.677425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.678190 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:18.678510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.680870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d30060c-7ddf-4426-a2c3-24855f42ccbd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.700545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 181/350] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.702021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840172-6749-48d9-a2b0-869c1ea4444a None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.702318 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840172-6749-48d9-a2b0-869c1ea4444a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.702599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00840172-6749-48d9-a2b0-869c1ea4444a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.703321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88a853-11d9-4fd0-b931-1b967fdfaf9f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.725835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-00840172-6749-48d9-a2b0-869c1ea4444a None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:18.731223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-00840172-6749-48d9-a2b0-869c1ea4444a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:18.763460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:18.766270 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.766270 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.766270 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.774143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:18.775696 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:18.779553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 170/351] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:18.780377 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:18.857433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 182/352] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:18.859242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:18.859620 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:18.859899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:18.888356 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:18.890074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:18.947279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c71086-cc00-4c8e-ba76-eddd66b3de8c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:18.999942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.000630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.001151 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.001225 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.017175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.094987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.114081 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.115955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.123609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 183/353] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:18 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:19.123609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.242053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b2d098-10ea-41c5-b32b-6dd18d2b7989 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.258026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 171/354] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:18 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:19.258888 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.287729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964079d-6422-48db-a9d2-4d23787d80e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.288447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964079d-6422-48db-a9d2-4d23787d80e3 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.288735 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964079d-6422-48db-a9d2-4d23787d80e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.289017 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964079d-6422-48db-a9d2-4d23787d80e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.311007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.357958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.373672 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964079d-6422-48db-a9d2-4d23787d80e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.375954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6964079d-6422-48db-a9d2-4d23787d80e3 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.391559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cec74a6-31ab-4eb0-90ca-9d1967c413f8 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.437633 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.438693 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.439176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.439672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.440719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=7f70b5c49945444ba47db4a46d4848f5) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:19.441032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.442563 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.449889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 172/355] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=51992cc8771e4114ab2620b57493b066 => generated 261 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:19.451982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.512348 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 184/356] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:19.514636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08722e-0ad7-448f-903a-0dc37ac594b0 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.514924 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08722e-0ad7-448f-903a-0dc37ac594b0 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.515195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08722e-0ad7-448f-903a-0dc37ac594b0 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.520927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 185/357] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:19 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:19.520927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08722e-0ad7-448f-903a-0dc37ac594b0 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.625006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e05e3-d320-4e0b-a1b4-3268280873a0 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.629275 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.661844 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:19.677984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08722e-0ad7-448f-903a-0dc37ac594b0 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.681453 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.682506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.683058 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.686266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.702967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:19.717569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:19.718755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 173/358] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:19.723772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.731670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001626-789f-483b-b37f-476831d58f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.732634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001626-789f-483b-b37f-476831d58f86 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.732980 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001626-789f-483b-b37f-476831d58f86 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.733368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57001626-789f-483b-b37f-476831d58f86 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.749603 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57001626-789f-483b-b37f-476831d58f86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-57001626-789f-483b-b37f-476831d58f86 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:19.758996 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:19.760213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 186/359] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:19.761656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001626-789f-483b-b37f-476831d58f86 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.903668 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100eb8e0-038d-4a4d-ab26-65af16dfbd57 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.927159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57001626-789f-483b-b37f-476831d58f86 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:19.960095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28d9a48-83d3-4fde-8505-ea0adaab37ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.961360 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d9a48-83d3-4fde-8505-ea0adaab37ef None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.961784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d9a48-83d3-4fde-8505-ea0adaab37ef None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.962198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28d9a48-83d3-4fde-8505-ea0adaab37ef None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.964329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d9a48-83d3-4fde-8505-ea0adaab37ef None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.966276 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28d9a48-83d3-4fde-8505-ea0adaab37ef None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.969389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 174/360] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:19.970974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc930e-7888-473a-b985-14c80663704e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.971537 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc930e-7888-473a-b985-14c80663704e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.972009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc930e-7888-473a-b985-14c80663704e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.980182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:19.981082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:19.981373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:19.981652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:19.984833 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:19.986338 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:19.988350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 187/361] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:19.993002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:19.998855 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-5efc930e-7888-473a-b985-14c80663704e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:20.001868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-5efc930e-7888-473a-b985-14c80663704e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:20.022362 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.044851 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.119804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 175/362] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:19 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:20.120794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc930e-7888-473a-b985-14c80663704e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.165492 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7efc1cf-d165-4214-96b4-38bed51a86a9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.228021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.229313 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.229909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.230477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.233979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:20.233979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.233979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.249251 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 188/363] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:19 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:20.249904 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.337468 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc930e-7888-473a-b985-14c80663704e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.393133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.394080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.394393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.394639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.396267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:20.396720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.399095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.408355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.409204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 176/364] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/roles?name=reader => generated 343 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:20.416146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.453991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f324395-04f1-4712-b7be-76b49ce0d375 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.462024 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.515684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.517105 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.517559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.518023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.520274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.522811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.530768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 189/365] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:20.530768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.591367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59123ee9-5fe8-453c-9611-38d072faf68e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.639787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.641002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.641434 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.641840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.643600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:20.645530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:20.648912 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 177/366] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:20.649056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.705830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d5282-ab2f-42d3-989c-096ee1ca7ff9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.747087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.747934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.748210 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.748486 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.761988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:20.771231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:20.772388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:20.773298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:20.775595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 190/367] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:20.776598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:20.791497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.806895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:20.825956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb32f6-c053-428c-9640-8b3eaa05c7b8 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.879443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:20.880944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:20.880944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:20.880944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:20.937783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e96f8c-f03e-4e29-a423-1836e3038087 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:20.999611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.000997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.001863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.003179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.003599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.003898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] PATH_INFO: `/v3/users/1b17c8e2b19d4cb9aeb1825acdc66516` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.008107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] RBAC: Authorizing `identity:get_user(user_id=1b17c8e2b19d4cb9aeb1825acdc66516)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.008107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.009245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 191/368] 10.222.0.112 () {56 vars in 1182 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/users/1b17c8e2b19d4cb9aeb1825acdc66516 => generated 294 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.012748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.117643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.144477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.152646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e14a9c1-974d-48e8-aeee-67e31d46d3ea None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.163432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 178/369] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:20 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:21.164323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.197504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.198438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.199540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.199540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.200543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=d00c53df360c4f8d9b34db69653b5898) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.200543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.203446 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.208844 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 192/370] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=51992cc8771e4114ab2620b57493b066 => generated 261 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.209444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.362017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7e128-ff58-41f1-8024-9cea4ea9c4cd None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.374224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c7a7cf-3559-4de7-8a6f-73258f489031 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.431805 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.432689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.432974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.433254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.434118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=7f70b5c49945444ba47db4a46d4848f5) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.434428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.436324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.445760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 179/371] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=dd47724fb39b480896a4a89456effdf6 => generated 261 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.447475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.453655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.454630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.455119 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.455703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.457138 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.457676 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.460799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.479013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 193/372] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.480371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.481316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.624969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:21.695345 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ab49a-20d9-4c5e-a4d0-3ec4b7288945 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.765068 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb34ee5-2da4-460d-824e-c1532f1b21de None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:21.786104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.786904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.787195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.787509 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.788359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] RBAC: Adding query filter params (role.id=6e4fac15600a46c5a7c117d4507040eb, user.id=1b17c8e2b19d4cb9aeb1825acdc66516, scope.system=all) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:21.788671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.790156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.834275 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 180/373] 10.222.0.112 () {56 vars in 1313 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/role_assignments?user.id=1b17c8e2b19d4cb9aeb1825acdc66516&scope.system=all&role.id=6e4fac15600a46c5a7c117d4507040eb => generated 512 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.835473 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:21.843299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:21.844774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:21.845462 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:21.845918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:21.854121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:21.856134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:21.858107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 194/374] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:21.874015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.056266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.114751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9075bed-4cd3-4743-b8e5-29b1bdba9ddd None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.135515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.142993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500c476-f892-452c-ad9d-90497eafb330 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.162751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.164215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.164699 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.165148 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.228779 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.230047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.230047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.230265 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.237048 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.239102 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.241731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 195/375] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:22.247571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.251330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.253265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.380789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 181/376] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:21 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:22.388672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.421395 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.501830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9e6701-1a38-4bfd-a755-96537369c1a7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.572053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.573102 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.573598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.574057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.577059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=d00c53df360c4f8d9b34db69653b5898) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:22.577633 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.580013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75652069-400a-4d34-93cb-4eb08618551a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.590433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.597534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cdc710-9b72-4a8e-bd58-28342f6de741 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.602665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 196/377] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=dd47724fb39b480896a4a89456effdf6 => generated 261 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:22.612825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777d993-7d28-4e4c-8613-a76e9fb22592 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.613287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777d993-7d28-4e4c-8613-a76e9fb22592 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.613818 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5777d993-7d28-4e4c-8613-a76e9fb22592 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.616767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 197/378] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:22 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:22.624413 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.624884 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.625336 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.670930 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.672821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.673552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.674248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] PATH_INFO: `/v3/projects/58b503a03d964e16b18f95569d131e22` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.676822 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] RBAC: Authorizing `identity:get_project(project_id=58b503a03d964e16b18f95569d131e22)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.680089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.684224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 182/379] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/projects/58b503a03d964e16b18f95569d131e22 => generated 345 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:22.688684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:22.689938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:22.691036 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.819378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:22.843048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca022c-1d11-4cb3-998a-12f475d9ba0c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:22.909455 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 198/380] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:22 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:22.931651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:22.932570 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:22.932850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:22.933124 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] PATH_INFO: `/v3/groups/032a8eed252041dc97ce51a0d9dbdb8f` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:22.948104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] RBAC: Authorizing `identity:get_group(group_id=032a8eed252041dc97ce51a0d9dbdb8f)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:22.949613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:22.951744 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 183/381] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/groups/032a8eed252041dc97ce51a0d9dbdb8f => generated 230 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:22.958211 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:22.968432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:23.165064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3919f43-f05b-47cf-aa1e-9bcdebb12b92 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:23.223439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:23.224264 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.224553 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.227496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.227496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] RBAC: Adding query filter params (group.id=032a8eed252041dc97ce51a0d9dbdb8f, role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=58b503a03d964e16b18f95569d131e22) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:23.227496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:23.227943 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:23.230646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f21000-4eac-4bc9-a1d7-aad381d9bd80 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:23.231778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:23.236320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 199/382] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/role_assignments?group.id=032a8eed252041dc97ce51a0d9dbdb8f&scope.project.id=58b503a03d964e16b18f95569d131e22&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 261 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:23.296347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:23.297598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.298110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.298605 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.317834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:23.330997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:23.332107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:23.332969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:23.336735 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 184/383] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:23.343717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:23.515100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e4981c-62a9-4a6c-b20a-d441757f28a4 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:23.574524 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:23.575303 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.575616 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.575896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.576748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:23.577068 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:23.579291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:23.595379 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 200/384] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:23 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:23.604077 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:23.615425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:23.796998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c0a645-7047-401a-be2a-b2e15ef39927 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:23.884210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:23.885643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:23.886128 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:23.886590 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:23.888563 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:23.891136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:23.894389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 185/385] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:23 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:23.903252 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.001105 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.076851 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7309dc0-8f5a-46fc-8a48-c18161aa368d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.120787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3e49fc-a648-4a83-8376-98a9b81f677e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.121685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e49fc-a648-4a83-8376-98a9b81f677e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.121973 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e49fc-a648-4a83-8376-98a9b81f677e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.122343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3e49fc-a648-4a83-8376-98a9b81f677e None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.123848 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e49fc-a648-4a83-8376-98a9b81f677e None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.125368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3e49fc-a648-4a83-8376-98a9b81f677e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.127439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 201/386] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:23 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:24.133452 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.221558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.247687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379a11f1-481e-4067-8e2f-b161a4f531c1 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.297572 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093eac1-8582-4279-a1fc-bc8208d8b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.298914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093eac1-8582-4279-a1fc-bc8208d8b436 None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.299416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093eac1-8582-4279-a1fc-bc8208d8b436 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.299886 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093eac1-8582-4279-a1fc-bc8208d8b436 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5/groups/13cd67c3928d4750b108e1139ec04986/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.305177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093eac1-8582-4279-a1fc-bc8208d8b436 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f70b5c49945444ba47db4a46d4848f5, group_id=13cd67c3928d4750b108e1139ec04986, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:24.307909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093eac1-8582-4279-a1fc-bc8208d8b436 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:24.332630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 186/387] 10.222.0.112 () {58 vars in 1447 bytes} [Mon Jul 25 19:06:24 2022] PUT /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5/groups/13cd67c3928d4750b108e1139ec04986/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:24.403862 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1edd4d-5dba-4674-b60c-5c1e6cd8c623 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.404617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1edd4d-5dba-4674-b60c-5c1e6cd8c623 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.404617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1edd4d-5dba-4674-b60c-5c1e6cd8c623 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.406461 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 202/388] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:24.418305 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3aef8-1fcc-4ba8-a500-2359f4f1e47c None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.419421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3aef8-1fcc-4ba8-a500-2359f4f1e47c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.420303 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd3aef8-1fcc-4ba8-a500-2359f4f1e47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.452369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-dbd3aef8-1fcc-4ba8-a500-2359f4f1e47c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:24.453963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-dbd3aef8-1fcc-4ba8-a500-2359f4f1e47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:24.568613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 187/389] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:24.608856 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1edd4d-5dba-4674-b60c-5c1e6cd8c623 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.612601 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb011b-9fdd-4fa9-865a-34c2e8110c5c None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.613232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb011b-9fdd-4fa9-865a-34c2e8110c5c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.613787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb011b-9fdd-4fa9-865a-34c2e8110c5c None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.615484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 188/390] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:24 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:24.625197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.625848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.626400 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.656765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:24.658907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:24.797553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.820120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 189/391] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:24 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:24.830377 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1edd4d-5dba-4674-b60c-5c1e6cd8c623 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:24.869963 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:24.894157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:24.895209 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:24.895522 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:24.895814 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:24.900426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:24.930983 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:24.939023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:24.940137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:24.941734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 203/392] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:24.948393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.161756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255021e7-f3a1-4f7f-abd1-6a69447abf2c None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.224919 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcf88bf-f262-4d2a-ba94-47cd459d6f11 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.244195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.245538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.245873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.246361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.285596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:25.295089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:25.296217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:25.297025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:25.309694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 190/393] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 410 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:25.318928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.337643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.338400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.338687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.338980 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.339820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.340132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.341772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.357794 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 204/394] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:24 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 410 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.364081 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.470927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.478997 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:25.559694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d79179-fc06-462d-a85a-5841698559cc None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.614221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9b827-22a4-4ce8-9ab9-8894415c7194 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.618549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.619944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.620445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.620966 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.623463 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.629482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.631660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 205/395] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.637828 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.741193 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:25.742381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:25.742910 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:25.743448 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:25.744662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:25.744974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:25.746712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:25.776548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 191/396] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:25.782067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:25.939765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49266b2a-8f06-4893-a00a-46ed5047d488 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:25.973826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.016110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c97246-0fd6-408a-865f-fda1ca0faff9 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.026674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b75857-ad19-43af-a4cc-5a2b2c851302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.028586 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75857-ad19-43af-a4cc-5a2b2c851302 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.029309 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75857-ad19-43af-a4cc-5a2b2c851302 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.029940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b75857-ad19-43af-a4cc-5a2b2c851302 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.032361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b75857-ad19-43af-a4cc-5a2b2c851302 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.036249 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b75857-ad19-43af-a4cc-5a2b2c851302 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.040829 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 206/397] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:26.044528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74663b7-db22-4abe-baa6-881f9a42ea35 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.045308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74663b7-db22-4abe-baa6-881f9a42ea35 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.045844 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74663b7-db22-4abe-baa6-881f9a42ea35 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.051530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 207/398] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:26 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:26.053564 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74663b7-db22-4abe-baa6-881f9a42ea35 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.059898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.098198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031f9fcb-f209-4ca5-a76f-0df04f337afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.100123 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9fcb-f209-4ca5-a76f-0df04f337afa None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.101194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9fcb-f209-4ca5-a76f-0df04f337afa None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.102295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031f9fcb-f209-4ca5-a76f-0df04f337afa None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.104983 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9fcb-f209-4ca5-a76f-0df04f337afa None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.107663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031f9fcb-f209-4ca5-a76f-0df04f337afa None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.119537 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 192/399] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:25 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:26.121822 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.122495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.123222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.152737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:26.155131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:26.228978 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74663b7-db22-4abe-baa6-881f9a42ea35 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.282267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 193/400] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:26.283998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.296384 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.300670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.301340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.302932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898/groups/13cd67c3928d4750b108e1139ec04986/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.311607 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] RBAC: Authorizing `identity:create_grant(project_id=d00c53df360c4f8d9b34db69653b5898, group_id=13cd67c3928d4750b108e1139ec04986, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.314319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.336085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 208/401] 10.222.0.112 () {58 vars in 1447 bytes} [Mon Jul 25 19:06:26 2022] PUT /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898/groups/13cd67c3928d4750b108e1139ec04986/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:26.337863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.402386 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.462376 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa074c50-2c95-49f2-832c-f04a3805c28e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.479954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.504874 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.505783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.506112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.506336 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.507437 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7d694-1a2c-4792-831a-53d99d2f578d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.508074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.509294 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.511064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 194/402] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:26 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:26.517429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.573123 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.575445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.576237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.576963 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.596876 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:26.613858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:26.615436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:26.616790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:26.620906 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 209/403] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:26.628147 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.652283 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc3f9e-91d3-4a46-92ce-1c0be4984eb6 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.695458 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21497f47-3f59-4efe-bd07-1034d506ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.697127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21497f47-3f59-4efe-bd07-1034d506ea12 None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.697708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21497f47-3f59-4efe-bd07-1034d506ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.698183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21497f47-3f59-4efe-bd07-1034d506ea12 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5/groups/13cd67c3928d4750b108e1139ec04986/roles/dd47724fb39b480896a4a89456effdf6` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.700922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21497f47-3f59-4efe-bd07-1034d506ea12 None admin] RBAC: Authorizing `identity:create_grant(project_id=7f70b5c49945444ba47db4a46d4848f5, group_id=13cd67c3928d4750b108e1139ec04986, role_id=dd47724fb39b480896a4a89456effdf6)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.702720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21497f47-3f59-4efe-bd07-1034d506ea12 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.726318 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 195/404] 10.222.0.112 () {58 vars in 1447 bytes} [Mon Jul 25 19:06:26 2022] PUT /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5/groups/13cd67c3928d4750b108e1139ec04986/roles/dd47724fb39b480896a4a89456effdf6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:06:26.784351 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ea281-f87b-4b1a-9ac0-c7c8d7ef273e None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:26.786218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:26.826680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0372-8dcb-4fc6-b03f-0e649063cec6 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.826680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0372-8dcb-4fc6-b03f-0e649063cec6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.826680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218b0372-8dcb-4fc6-b03f-0e649063cec6 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.828847 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 196/405] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:26 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:26.832256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:26.832970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.833261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.833547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.834324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:26.834637 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:26.836223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:26.837202 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:26.837493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:26.838122 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:26.850246 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 210/406] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:26 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:26.860925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:26.868846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:26.870570 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:26.963932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.003680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 197/407] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:26 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:27.033989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.048936 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25081f4b-24ef-4ae3-a7f4-89e36f2c63e6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.100212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.101000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.101280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.101559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.102858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:27.104394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:27.106467 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 211/408] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:26 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:27.116475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.166666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a176dc-a757-404b-963d-5f1993a4dd32 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.202131 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.215591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.216420 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.216703 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.216978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.229530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:27.237896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:27.239498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:27.241062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 198/409] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:27.247925 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.302072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.328926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b212e7-64a8-4c99-bedb-c196dcc2c5c8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.384602 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32581f0f-8b8a-4555-ba42-59e6d9cd0ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.388811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32581f0f-8b8a-4555-ba42-59e6d9cd0ae8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.389708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32581f0f-8b8a-4555-ba42-59e6d9cd0ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.390209 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32581f0f-8b8a-4555-ba42-59e6d9cd0ae8 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.392565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32581f0f-8b8a-4555-ba42-59e6d9cd0ae8 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:27.395291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32581f0f-8b8a-4555-ba42-59e6d9cd0ae8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:27.397402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 212/410] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:27.399297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0319a3-08be-40a0-950c-9023ebdc9e72 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.399613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0319a3-08be-40a0-950c-9023ebdc9e72 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.399897 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0319a3-08be-40a0-950c-9023ebdc9e72 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.401568 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 213/411] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:27 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:27.408989 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0319a3-08be-40a0-950c-9023ebdc9e72 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.411469 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6486344-6c93-4c65-8f78-026e7f075da9 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.459172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.460447 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.461042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.461575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.462859 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:27.463580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:27.466716 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686a7bd9-4726-401a-adba-9d573fd95611 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:27.481609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 199/412] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:27.483348 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.483748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.484095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.506652 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:27.508194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:27.541078 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.547376 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0319a3-08be-40a0-950c-9023ebdc9e72 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.585209 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.586122 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.586398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.586670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898/groups/13cd67c3928d4750b108e1139ec04986/roles/dd47724fb39b480896a4a89456effdf6` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:27.589662 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] RBAC: Authorizing `identity:create_grant(project_id=d00c53df360c4f8d9b34db69653b5898, group_id=13cd67c3928d4750b108e1139ec04986, role_id=dd47724fb39b480896a4a89456effdf6)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:27.591094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:27.615718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 214/413] 10.222.0.112 () {58 vars in 1447 bytes} [Mon Jul 25 19:06:27 2022] PUT /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898/groups/13cd67c3928d4750b108e1139ec04986/roles/dd47724fb39b480896a4a89456effdf6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:27.617074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.627839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 200/414] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:27 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:27.652817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:27.729413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:27.913269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e89b53-3890-41ed-801f-b299799b70dc None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.949873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f6049-9910-4fea-9bc9-769f1c2a2a7d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:27.985520 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:27.987480 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:27.988407 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:27.989126 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.011667 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:28.021353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.022745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.023216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.023713 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] PATH_INFO: `/v3/groups/032a8eed252041dc97ce51a0d9dbdb8f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.027073 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] RBAC: Authorizing `identity:get_group(group_id=032a8eed252041dc97ce51a0d9dbdb8f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:28.028973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:28.030646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:28.032279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:28.033438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.033438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 215/415] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/groups/032a8eed252041dc97ce51a0d9dbdb8f => generated 230 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:28.037560 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 201/416] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:28.041782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.043706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.100035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.291916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.325887 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e7e5-2e59-4e51-9622-ed90006be528 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.342339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85afb64-7431-4703-b2f0-2725c4b7830f None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.396230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.397101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.397378 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.397649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] PATH_INFO: `/v3/projects/58b503a03d964e16b18f95569d131e22` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.401509 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] RBAC: Authorizing `identity:get_project(project_id=58b503a03d964e16b18f95569d131e22)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.401509 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.402057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 216/417] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/projects/58b503a03d964e16b18f95569d131e22 => generated 345 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:28.411514 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.437803 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.438891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.439370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.439869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.441247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] RBAC: Adding query filter params (name=member) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:28.441779 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.444276 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.479107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 202/418] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 436 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:28.486788 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:28.611872 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.620775 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f5930-43be-44f1-889f-8b2d90f30412 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.668295 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.669464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.669738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.670015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] PATH_INFO: `/v3/projects/58b503a03d964e16b18f95569d131e22/groups/032a8eed252041dc97ce51a0d9dbdb8f/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.672268 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] RBAC: Authorizing `identity:create_grant(project_id=58b503a03d964e16b18f95569d131e22, group_id=032a8eed252041dc97ce51a0d9dbdb8f, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.673718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:28.699671 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 217/419] 10.222.0.112 () {58 vars in 1447 bytes} [Mon Jul 25 19:06:28 2022] PUT /identity/v3/projects/58b503a03d964e16b18f95569d131e22/groups/032a8eed252041dc97ce51a0d9dbdb8f/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:28.729415 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90ea90-dd0f-4531-926d-b4b3c882aaec None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:28.790500 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:28.791790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:28.792482 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:28.793213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:28.827449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:28.912943 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:28.914392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.046056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 203/420] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:28 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:06:29.052560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.174249 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96371fa6-f047-4375-bb0e-0fc5238f87bb None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.211344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.212300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.212590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.212908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.214526 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.216059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.218086 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 218/421] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:29.224017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.317687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.391909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba05c0-fa75-488a-a653-e1e9e5e6027e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.446868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a475f0-b993-491b-9ff2-236053efecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.448038 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a475f0-b993-491b-9ff2-236053efecc3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.448508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a475f0-b993-491b-9ff2-236053efecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.449847 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a475f0-b993-491b-9ff2-236053efecc3 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.452004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a475f0-b993-491b-9ff2-236053efecc3 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.453508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a475f0-b993-491b-9ff2-236053efecc3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.455240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 204/422] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:29.461773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.522693 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:29.659443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2ebe3-fc65-4b15-9f98-68a18dc09e5c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:29.689323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395d84-4e2d-4860-9825-c4f9f7bf9d7a None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.689840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395d84-4e2d-4860-9825-c4f9f7bf9d7a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.689914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8395d84-4e2d-4860-9825-c4f9f7bf9d7a None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.691896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 205/423] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:29.700974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b459-6866-40a5-b11f-2ffe1a252abf None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.701240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b459-6866-40a5-b11f-2ffe1a252abf None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.701518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f667b459-6866-40a5-b11f-2ffe1a252abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.709080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:29.709804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.710089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.710415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.711266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=7f70b5c49945444ba47db4a46d4848f5) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:29.711605 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:29.713077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128d490c-3ce3-402d-b5b3-603171718878 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:29.722202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 219/424] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=51992cc8771e4114ab2620b57493b066 => generated 613 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:29.739831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f667b459-6866-40a5-b11f-2ffe1a252abf None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:29.741067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f667b459-6866-40a5-b11f-2ffe1a252abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:29.864427 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 206/425] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:29.877898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d279-cf55-4352-8c8d-421cb5bb8730 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.878196 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d279-cf55-4352-8c8d-421cb5bb8730 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.878915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c4d279-cf55-4352-8c8d-421cb5bb8730 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.881852 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 220/426] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:29 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:29.887977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:29.888567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:29.889016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:29.905352 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4d279-cf55-4352-8c8d-421cb5bb8730 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:29.929680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:29.930893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:29.997795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.030597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 207/427] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:29 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:30.046246 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.059952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.067004 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c4d279-cf55-4352-8c8d-421cb5bb8730 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.123118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.124316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.124592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.124914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.139286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:30.148810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:30.150529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:30.152987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 221/428] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:30.157334 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.258087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ef80-5fc2-4472-9fc4-91f73292181e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.326109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.327603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.328136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.329017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.347433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c84d45-03c3-4957-88e2-42801e9dd69a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.351701 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:30.367723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:30.369765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:30.372054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 208/429] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:30.380190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.436660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.437341 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.437625 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.437902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.438660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:30.439623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.441248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.454001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 222/430] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/roles?name=member => generated 343 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:30.464580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.468212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.490038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.619165 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda06c4e-422c-4278-b00f-014795129018 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.633601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f0548-a9e0-401c-90db-dc0702f041e9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.671870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.673316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.673738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.674150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.679145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.679616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.680112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.680598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:30.682103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:30.682626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.685341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.703472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 209/431] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:30.711542 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.757471 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:30.759192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:30.776389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.857149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:30.868780 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6e88c2-50c0-4b68-b9d0-e0d70fd210c2 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:30.902907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 223/432] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:30.904107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:30.917974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b77fc-7306-4fa0-bb3e-334546d793bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:30.918641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b77fc-7306-4fa0-bb3e-334546d793bb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:30.919363 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b77fc-7306-4fa0-bb3e-334546d793bb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:30.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b77fc-7306-4fa0-bb3e-334546d793bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.004714 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b77fc-7306-4fa0-bb3e-334546d793bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.005843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b77fc-7306-4fa0-bb3e-334546d793bb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.042149 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c44fa9e-ff4f-4628-8893-9800ae54de99 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.055160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.080074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f22bb-d700-4d7b-ac46-a7dc0a6cf786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.080935 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f22bb-d700-4d7b-ac46-a7dc0a6cf786 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.081236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f22bb-d700-4d7b-ac46-a7dc0a6cf786 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.081563 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f22bb-d700-4d7b-ac46-a7dc0a6cf786 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.082742 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f22bb-d700-4d7b-ac46-a7dc0a6cf786 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.084217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f22bb-d700-4d7b-ac46-a7dc0a6cf786 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.085901 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 224/433] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.087063 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9c8f-f42d-47e4-9f05-6f0f9790e25c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.087346 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9c8f-f42d-47e4-9f05-6f0f9790e25c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.087641 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e9c8f-f42d-47e4-9f05-6f0f9790e25c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.093677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 225/434] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:31.093677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e9c8f-f42d-47e4-9f05-6f0f9790e25c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.123892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.136918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 210/435] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:30 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:31.136918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.136918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.136918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.153156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:31.154251 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:31.204190 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e9c8f-f42d-47e4-9f05-6f0f9790e25c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.227201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 211/436] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:31.231774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.244900 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.246109 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.246550 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.246988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.248628 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.250331 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.257215 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 226/437] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.257215 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.316052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.354784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec873f-fe5c-4781-a6ea-5ea96d545343 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.385843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.391908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6a29c-be8e-4c34-8029-52132514510a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.397724 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.398600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.398937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.399205 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] PATH_INFO: `/v3/projects/7f70b5c49945444ba47db4a46d4848f5` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.400508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] RBAC: Authorizing `identity:get_project(project_id=7f70b5c49945444ba47db4a46d4848f5)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.402234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.408668 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 212/438] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/projects/7f70b5c49945444ba47db4a46d4848f5 => generated 299 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.408668 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.442010 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.442857 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.443144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.443447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.460737 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:31.470371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:31.471353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 25 19:06:31.472537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:31.475744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 227/439] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:31.476851 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.532129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400c9e2-a21b-443b-9095-e6ef4eff3b22 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.584020 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.585046 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.585449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.585865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.587001 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=51992cc8771e4114ab2620b57493b066, scope.project.id=d00c53df360c4f8d9b34db69653b5898) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:31.587559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.589485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.599450 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 213/440] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=51992cc8771e4114ab2620b57493b066 => generated 613 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.599638 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bb2d78-b512-4354-ba07-6f7f3a56049a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.599729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.606277 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.645570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d239826-f199-4eaa-a443-59866c1311f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.646453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239826-f199-4eaa-a443-59866c1311f3 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.646758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239826-f199-4eaa-a443-59866c1311f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.647085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d239826-f199-4eaa-a443-59866c1311f3 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.648415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239826-f199-4eaa-a443-59866c1311f3 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.649899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d239826-f199-4eaa-a443-59866c1311f3 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.652514 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 228/441] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.658916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed872-6f4d-4d6d-ab7b-ba53ee310b8f None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.659120 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed872-6f4d-4d6d-ab7b-ba53ee310b8f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.659448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ed872-6f4d-4d6d-ab7b-ba53ee310b8f None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.665342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 229/442] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:31 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:31.665342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed872-6f4d-4d6d-ab7b-ba53ee310b8f None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.701090 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.750907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e640832-5b0d-471c-9dad-35beece93a59 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.791214 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.792325 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.792793 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.793086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.793837 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:31.794145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.795601 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c407d-2564-425a-a91a-6de8f5be2fdb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.801693 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ed872-6f4d-4d6d-ab7b-ba53ee310b8f None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:31.811549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 214/443] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/roles?name=anotherrole => generated 336 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.811549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.811549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.811549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.835345 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:31.836825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:31.850370 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:31.851571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:31.851571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:31.851895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:31.852666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=7f70b5c49945444ba47db4a46d4848f5) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:31.853043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:31.854708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:31.863791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 230/444] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=7f70b5c49945444ba47db4a46d4848f5&role.id=dd47724fb39b480896a4a89456effdf6 => generated 613 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:31.865565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:31.916700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:31.928769 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 215/445] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:31 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:31.955545 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.010535 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f84462-339a-4771-81af-79dd1e06bb76 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.021725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.063052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.064021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.064265 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.064547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.095332 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d59313-5685-47cf-9d5a-0fdf35635565 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.151860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.152739 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.153028 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.153304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.163841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.165346 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.169490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:32.177529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:32.178464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:32.179522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 216/446] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:32.184720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.217948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.303020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 231/447] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:31 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:32.310855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.343385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5afe7-3e7e-4285-a895-362f3ba151c2 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.360978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.406867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.408473 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.408969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.409451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.410691 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:32.411002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.413820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.433228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 217/448] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:32.439271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.464738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15424b68-c1ab-4f84-93c5-c1943615014a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.516093 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.517091 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.517401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.517675 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] PATH_INFO: `/v3/projects/d00c53df360c4f8d9b34db69653b5898` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.518932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] RBAC: Authorizing `identity:get_project(project_id=d00c53df360c4f8d9b34db69653b5898)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.520444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.522686 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 232/449] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/projects/d00c53df360c4f8d9b34db69653b5898 => generated 303 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:32.529129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.538804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.570216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fce794-1e55-4243-8baf-500043d87f52 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.611811 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.612188 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.612560 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.612838 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.657393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c100c-733a-45ca-bfb2-f9b69d0f3104 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.663295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.694386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.696009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.697859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.698720 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.699000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.699270 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] PATH_INFO: `/v3/groups/13cd67c3928d4750b108e1139ec04986` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.700475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] RBAC: Authorizing `identity:get_group(group_id=13cd67c3928d4750b108e1139ec04986)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.701889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.703558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 233/450] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/groups/13cd67c3928d4750b108e1139ec04986 => generated 227 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:32.711167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.810669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.826646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 218/451] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:32.834608 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:32.855871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f3546-dd6f-44fc-9de0-b13df7931d41 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.903494 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.904444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.904784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.905113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.906222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] RBAC: Adding query filter params (group.id=13cd67c3928d4750b108e1139ec04986, role.id=dd47724fb39b480896a4a89456effdf6, scope.project.id=d00c53df360c4f8d9b34db69653b5898) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:32.906712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.908447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.915894 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 234/452] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/role_assignments?group.id=13cd67c3928d4750b108e1139ec04986&scope.project.id=d00c53df360c4f8d9b34db69653b5898&role.id=dd47724fb39b480896a4a89456effdf6 => generated 613 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:32.931675 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:32.953903 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0bd5e7-1aeb-43ac-9f16-51c5071348c2 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:32.993198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:32.994460 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:32.994869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:32.994869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] PATH_INFO: `/v3/projects/58b503a03d964e16b18f95569d131e22` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:32.996304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] RBAC: Authorizing `identity:get_project(project_id=58b503a03d964e16b18f95569d131e22)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:32.997793 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:32.999805 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 219/453] 10.222.0.112 () {56 vars in 1191 bytes} [Mon Jul 25 19:06:32 2022] GET /identity/v3/projects/58b503a03d964e16b18f95569d131e22 => generated 345 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:33.008108 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:33.155830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68ede3d-5051-4688-a9bf-6c562ae321f7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:33.192371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7332f5-afd2-48b1-80bb-175e8493720e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:33.193248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7332f5-afd2-48b1-80bb-175e8493720e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:33.193527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7332f5-afd2-48b1-80bb-175e8493720e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:33.193827 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7332f5-afd2-48b1-80bb-175e8493720e None admin] PATH_INFO: `/v3/groups/032a8eed252041dc97ce51a0d9dbdb8f` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:33.195077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7332f5-afd2-48b1-80bb-175e8493720e None admin] RBAC: Authorizing `identity:get_group(group_id=032a8eed252041dc97ce51a0d9dbdb8f)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:33.197033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7332f5-afd2-48b1-80bb-175e8493720e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:33.199926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 235/454] 10.222.0.112 () {56 vars in 1185 bytes} [Mon Jul 25 19:06:33 2022] GET /identity/v3/groups/032a8eed252041dc97ce51a0d9dbdb8f => generated 230 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:33.206802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:33.339472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dd9910-7618-4da5-b1a2-09682e4c5643 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:33.381403 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:33.382082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:33.382363 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:33.382639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:33.383496 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] RBAC: Adding query filter params (group.id=032a8eed252041dc97ce51a0d9dbdb8f, role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=58b503a03d964e16b18f95569d131e22) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:33.383806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:33.385274 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2d31a-f6ef-4eed-a8ab-2966654a19b5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:33.391817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 220/455] 10.222.0.112 () {56 vars in 1381 bytes} [Mon Jul 25 19:06:33 2022] GET /identity/v3/role_assignments?group.id=032a8eed252041dc97ce51a0d9dbdb8f&scope.project.id=58b503a03d964e16b18f95569d131e22&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 613 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:36.169040 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096c18-add1-4857-8f28-d5fb0e2b1320 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.169040 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096c18-add1-4857-8f28-d5fb0e2b1320 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.169040 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f096c18-add1-4857-8f28-d5fb0e2b1320 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.169963 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 236/456] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:36.175614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1ad1-4b49-4283-8415-8539f1f5c67f None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.176434 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1ad1-4b49-4283-8415-8539f1f5c67f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.176902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f1ad1-4b49-4283-8415-8539f1f5c67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.184499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.197212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f67f1ad1-4b49-4283-8415-8539f1f5c67f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:36.198833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f67f1ad1-4b49-4283-8415-8539f1f5c67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:36.273157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 221/457] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:36.298740 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096c18-add1-4857-8f28-d5fb0e2b1320 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:36.309569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.425110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f096c18-add1-4857-8f28-d5fb0e2b1320 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:36.461760 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:36.462623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.463007 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.463405 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.464684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060efa79-f925-4f1f-b163-41258450f866 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.464979 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060efa79-f925-4f1f-b163-41258450f866 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.465264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060efa79-f925-4f1f-b163-41258450f866 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.467228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 222/458] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:36 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:36.472922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f268-7be7-4f9c-9fb0-d73d561761e3 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.473210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f268-7be7-4f9c-9fb0-d73d561761e3 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.473487 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954f268-7be7-4f9c-9fb0-d73d561761e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.476088 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:36.477819 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:36.495831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f954f268-7be7-4f9c-9fb0-d73d561761e3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:36.497712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f954f268-7be7-4f9c-9fb0-d73d561761e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:36.500053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:36.500972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:36.502043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:36.502043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:36.502043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:36.502043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:36.502043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 237/459] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:36.510910 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:36.581916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 223/460] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:36.582690 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.583039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001729ef-2606-41a7-9a18-086610e9aaf5 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.583765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001729ef-2606-41a7-9a18-086610e9aaf5 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.583765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001729ef-2606-41a7-9a18-086610e9aaf5 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.585183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 224/461] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:36.590931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.591306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.591709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.610831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:36.612448 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:36.640315 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c41dc2-b3bd-4ffe-8e78-8d9f325333b2 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:36.677440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:36.678022 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.678312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.678433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.678592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.679337 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:36.679729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:36.681219 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ccbc3e-639f-4546-849d-11fe10bced13 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:36.686916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 225/462] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:36.687884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:36.694650 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 238/463] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:36.696287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18dec-81d9-46d0-b73b-00c13b4280b0 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.696581 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18dec-81d9-46d0-b73b-00c13b4280b0 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.696864 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae18dec-81d9-46d0-b73b-00c13b4280b0 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.702056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 239/464] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:36.702056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18dec-81d9-46d0-b73b-00c13b4280b0 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:36.802435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36256eed-6cb2-4dac-8fa8-3b876aa25396 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:36.803738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae18dec-81d9-46d0-b73b-00c13b4280b0 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:36.824348 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.840413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:36.841222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.841368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e395423-ac89-4039-8f7c-890213f4c679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:36.841507 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.841785 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.841975 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395423-ac89-4039-8f7c-890213f4c679 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.842254 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395423-ac89-4039-8f7c-890213f4c679 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.842525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e395423-ac89-4039-8f7c-890213f4c679 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.843232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395423-ac89-4039-8f7c-890213f4c679 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:36.844698 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e395423-ac89-4039-8f7c-890213f4c679 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:36.853478 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:36.854919 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:36.873036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 240/465] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/users => generated 249 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:36.874335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:36.874628 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:36.874932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:36.876101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:36.876970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:36.877954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:36.877954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:36.877954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:36.877954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:36.877954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 226/466] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:36.878685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:36.906635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:36.907925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:36.941319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:36.996478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 241/467] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:36 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:36.997809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.012107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38640d-8dba-4500-8b2d-4ddca33f3058 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.055163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.056049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.058776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.058776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.069638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.071487 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:37.089902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:37.090799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:37.091711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:37.091711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:37.091711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:37.091711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:37.091711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 227/468] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:37.091974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.133517 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867444a4-ec92-4c26-b2a2-7171f527c9c3 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.137230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:37.181325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.182210 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.182335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.182813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.183439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:37.184692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.185162 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.199693 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 242/469] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:36 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:37.200461 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.217449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:37.224181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6040f3-e25e-426f-9255-25b32b69a8ca None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.269486 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.270300 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.270588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.276316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.293643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.295225 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:37.320756 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:37.321684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:37.322540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:37.322540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:37.322540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:37.322540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:37.323187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 228/470] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:37.323884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.357687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9c303e-9b77-4200-b9e3-abe291e61ca4 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.406445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.407848 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.408305 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.408752 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.410199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:37.411105 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.414042 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.430637 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 243/471] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:37.431257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.475510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:37.483056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f14979-706e-4482-95d4-f93d1d9f67a3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.541901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.543036 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.543554 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.544187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.547018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.549152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.581110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 229/472] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:37 2022] POST /identity/v3/users => generated 249 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:37.582974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.600472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:37.619665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d499-8ac5-4e62-920c-52076b118c18 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.689261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.690601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.691053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.691770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.692865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:37.693368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.696308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.718406 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 244/473] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:37.729716 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:37.779126 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ee7d-b59f-40c8-9e8c-35e3e027e702 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.837580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc993a-2dde-497b-a3b1-b89ba38337a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.838209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc993a-2dde-497b-a3b1-b89ba38337a5 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.838495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc993a-2dde-497b-a3b1-b89ba38337a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.838779 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc993a-2dde-497b-a3b1-b89ba38337a5 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.839730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc993a-2dde-497b-a3b1-b89ba38337a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.841215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fc993a-2dde-497b-a3b1-b89ba38337a5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.852153 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:37.873871 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 230/474] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:37 2022] POST /identity/v3/users => generated 247 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:37.875687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfdaceb-f637-4c26-87f3-e7e0efe38076 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:37.928749 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc742d3-fbe2-4f43-ab5d-68295348f084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:37.929444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc742d3-fbe2-4f43-ab5d-68295348f084 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:37.929777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc742d3-fbe2-4f43-ab5d-68295348f084 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:37.930026 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc742d3-fbe2-4f43-ab5d-68295348f084 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:37.930747 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc742d3-fbe2-4f43-ab5d-68295348f084 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:37.932772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc742d3-fbe2-4f43-ab5d-68295348f084 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:37.965167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 245/475] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:06:37 2022] POST /identity/v3/users => generated 250 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:06:39.326499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbedc0-01e5-4993-acfe-76731fb56c5a None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.327715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbedc0-01e5-4993-acfe-76731fb56c5a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.328224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddbedc0-01e5-4993-acfe-76731fb56c5a None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.330323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 231/476] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:39 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:39.336694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.337643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.338148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.358503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:39.360109 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:39.444185 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 246/477] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:39 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:39.470677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbedc0-01e5-4993-acfe-76731fb56c5a None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.546225 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:39.597032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddbedc0-01e5-4993-acfe-76731fb56c5a None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.635694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.637222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.637701 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.638209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.653108 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:39.665355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:39.666567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:39.667513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:39.674003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 232/478] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:39.677613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:39.772480 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:39.813784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d7cfdd-96a9-44eb-bbfb-19353541c346 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:39.863082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:39.863923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:39.864313 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:39.864655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:39.865565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:39.865960 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:39.867773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:39.884610 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 247/479] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:39.891907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.026860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c1644-b63f-4825-a504-e4ed9054fe1c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.060509 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.070569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.072109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.072632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.073671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.086944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:40.089264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-b5919411-cf85-4447-953f-971a190ab51d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:40.110609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:40.111810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:40.112697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:40.112697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:40.112697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:40.112697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:40.118165 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 233/480] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:40.120979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.167707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4e62f-93e6-41db-803f-a54849730442 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.168073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4e62f-93e6-41db-803f-a54849730442 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.168287 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4e62f-93e6-41db-803f-a54849730442 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.170084 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 234/481] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:40.176289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.176650 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.176853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.198473 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:40.199790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:40.266862 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca482ba-e620-4a16-8dd4-fe6623ef8d25 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.295906 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 235/482] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:40.306508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.314432 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.314903 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.315875 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.316524 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.317561 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.320549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:40.320925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:40.322468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:40.341838 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 248/483] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:40.345582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.450338 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ee9c-f661-4e2d-8d2d-90a25f62fc55 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.456084 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.506810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e36e00-cc93-413e-af51-f128a97600e9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.507508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.508852 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.509301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.509708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.527567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:40.541197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:40.542429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:40.543296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:40.547826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 236/484] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:40.550087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.555606 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.557912 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.558700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.559315 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] PATH_INFO: `/v3/users/glance` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.574644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:40.576151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:40.599286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:40.600335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:40.601744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 249/485] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:40.609159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.686418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70740812-52d6-480a-94d0-3aaa6600197a None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.702902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.748506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.749649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.750381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.750863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.757480 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] RBAC: Adding query filter params (name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:40.758044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:40.760971 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526f9f5d-a490-44ec-b71c-d0d5d8bc61fe None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:40.783179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693631d-5bf5-4f67-8450-1c4b2b26f06b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.783918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 237/486] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:40.786243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccdbb7-fee9-490d-ae1a-bb225170bd2f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.786730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccdbb7-fee9-490d-ae1a-bb225170bd2f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.787229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ccdbb7-fee9-490d-ae1a-bb225170bd2f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.789735 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 238/487] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:40.791064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccdbb7-fee9-490d-ae1a-bb225170bd2f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:40.838947 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:40.844042 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.844630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.844914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.845186 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.846110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:40.846414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:40.848189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac34e43-a58a-4b89-ab98-9ce528c502a9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:40.900724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 250/488] 10.222.0.112 () {56 vars in 1142 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:40.902435 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af786df-c8c9-4d15-b7dd-e07915dd038b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.902874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af786df-c8c9-4d15-b7dd-e07915dd038b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.903283 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af786df-c8c9-4d15-b7dd-e07915dd038b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:40.922898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-8af786df-c8c9-4d15-b7dd-e07915dd038b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:40.927931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-8af786df-c8c9-4d15-b7dd-e07915dd038b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:40.946163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ccdbb7-fee9-490d-ae1a-bb225170bd2f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:40.987135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:40.989708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:40.989995 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:40.990509 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.006413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.007937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.012841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 251/489] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:40 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:41.014261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783651-3764-4efe-8749-7c0892848c91 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.014626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783651-3764-4efe-8749-7c0892848c91 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.015020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40783651-3764-4efe-8749-7c0892848c91 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.017174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 252/490] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:41.018267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783651-3764-4efe-8749-7c0892848c91 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-e6377037-cc33-4695-a2fb-b8e9ec732dd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:41.038391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:41.039444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:41.041017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:41.041017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:41.041017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:41.041017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:41.041017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 239/491] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:41.041017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.041678 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.041678 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.064183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:41.065482 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:41.076297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.154429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40783651-3764-4efe-8749-7c0892848c91 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.165287 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 240/492] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:41 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:41.167354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.183339 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.204578 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.205336 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.205613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.205895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.289250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.290884 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.317758 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98685b44-32cf-481a-a5a1-178f3f59063e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.339931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.379706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.381061 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.381566 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.382104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.402882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:41.418677 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:41.419754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:41.420552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:41.421382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 241/493] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:41.422555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.423006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 253/494] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:41.424707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.523523 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.555674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c9e69e-8e07-40ac-b26f-f196a68fc65b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.565859 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e20b1-de9d-4b93-9cae-b2ed7744a692 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.593689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.594651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.595156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.595701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.609376 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.613236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.614026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.614315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.614590 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.615721 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:41.615721 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.617607 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.623798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:41.631688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 242/495] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:41.632557 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:41.635425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:41.636596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:41.637419 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 254/496] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:41.638099 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.758449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08fbec-037a-4365-9ba5-1d93be292bc5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.795330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:41.799150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e482cdb-0717-465a-9175-7ce9c24ad79c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:41.806323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.807593 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.808014 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.808327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.821241 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.823103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:41.844290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:41.846346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:41.848465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:41.848465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:41.848465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:41.848465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:41.848465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 243/497] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:41.848465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.868132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:41.869652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:41.870189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:41.870705 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:41.872307 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:41.872892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:41.875716 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:41.897009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 255/498] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:41.897009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:41.985293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4a949e-ad3a-45eb-957d-a9952cfad0eb None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.001216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.033800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.034695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.035060 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.035384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.047330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.049862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.060680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a02abc7-4e4b-4489-80e5-81799516d501 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:42.075958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.077095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 244/499] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:42.078359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.115729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.116405 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.116687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.116964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.117712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.118016 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.119425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.128558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 256/500] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:41 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:42.129399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.129545 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.218022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66061c21-c076-4dac-955d-c5024ac314ee None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.258965 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.259915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.260297 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.260787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.261764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.267112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.267112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.269604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a82279-899f-4518-94c9-ac5a04b1c886 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.278848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 245/501] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:42.279885 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.294592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.307238 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.308071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.308353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.308624 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.321017 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.322601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:42.347242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.348644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.349922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:42.349922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:42.349922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:42.349922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:42.349922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 257/502] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:42.349922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.409681 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.414167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dc01f-c7b9-4c77-8436-7e54f43539a3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.462777 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.463772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.464180 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.464713 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.466265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.466849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.469243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.469454 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9126-c19c-4534-9379-916e5d2496b3 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.512316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 246/503] 10.222.0.112 () {56 vars in 1142 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:42.513819 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.523180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.524601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.525104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.525599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.543168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.544700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:42.564151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.565896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.566878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:42.566878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:42.566878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:42.566878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:42.566878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 258/504] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:42.566878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.603697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.635687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea870d5c-68c5-43f2-923d-42fd08f28fc7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.683093 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.683928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.684203 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.684471 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.692284 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.693780 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.702968 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14214a3-762e-4678-9548-655cca1dac90 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:42.709169 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:42.711161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 247/505] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:42.712970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.738176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.762193 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.762886 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.763171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.763488 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.764239 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:42.764550 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.765968 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:42.780754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 259/506] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:42.781801 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:42.847830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe001b2-550e-46c5-b5a7-05fe59c40352 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.898324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:42.898904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:42.899197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:42.899545 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:42.938777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:42.958779 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261ba38f-91a1-412d-99fc-e5b8ebbddf09 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:42.992609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:42.994146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.000632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.001383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.001761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.002135 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.003036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.003426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.004977 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.014806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.018184 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 260/507] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.019028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.127739 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 248/508] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:42 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:43.129479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.151344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac8104-5d47-4b00-997b-550e79ce3766 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.199203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.199965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.200248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.200525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.201350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.201660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.203224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.228842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 261/509] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.230595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.247792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.258246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfde137-3ae4-47a2-bad9-721dce764b05 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.282019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.307087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.308052 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.308346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.308636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.316806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.318318 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:43.334099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:43.336078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 249/510] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:43.337782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.363544 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ccaa2b-4ad0-4b22-94ec-20b56a3eb157 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.405670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.406817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.407193 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.407644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.417307 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.419073 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:43.435074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:43.436096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:43.437000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:43.439758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 262/511] 10.222.0.112 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:43.441258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.467067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44e9eb0-6201-4504-bd9e-b79abff5293d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.508031 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.509278 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.509757 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.510242 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.521002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.527362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.530107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:43.552613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:43.554198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:43.555798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:43.555798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:43.555798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:43.555798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:43.555798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 250/512] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:43.555798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.560770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3fcc6c-4185-4398-90cd-bfbd0cd2fb24 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.592372 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.600652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.601313 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.601600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.601877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.602718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=fbb8bab39c68414b8db430d75072f892) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.603036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.604508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.610831 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 263/513] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/role_assignments?user.id=fbb8bab39c68414b8db430d75072f892&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.612807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.689619 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f67232-aaa1-47ee-a36d-3a29808649a7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.730597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.731656 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.732121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.732563 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.733425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.733738 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.735237 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.760553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 251/514] 10.222.0.112 () {56 vars in 1144 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.760553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.781278 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fb7dd8-0cbb-4725-a9bf-3129a2c404c6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.833611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.843240 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.844498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.844994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.846290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.847329 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.848399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.851776 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.879203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 264/515] 10.222.0.112 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.880166 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:43.904413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:43.923209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6d941-a48a-407e-87cd-15fd3d1efed5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:43.970421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:43.971298 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:43.971790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:43.972265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:43.973133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:43.973510 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:43.975022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:43.990140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 252/516] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:43.991311 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.054551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb732792-74ee-4ea8-9a5b-dcf5ae2c06a7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.119174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.120271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.120738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.121212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.149887 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0515549-2e16-4a25-9bff-8e4ca84f3563 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.202732 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.203841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.204340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.204796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.229281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.232617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.245845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.248739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.305198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.306685 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.398882 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 265/517] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:44.398882 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.446246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 253/518] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:43 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:44.446246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.519010 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.531559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.545205 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c97f488-405a-405e-9df3-cfb2e7968f81 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.581132 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb7e3d-aa64-44bf-8e0e-f40adb9380c3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.584830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.585871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.586052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.586288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.596973 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.597429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:44.612144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:44.613640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 266/519] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:44.615154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.639004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.639845 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.640129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.640406 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.652196 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.653987 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:44.679524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:44.680843 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:44.681706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:44.681706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:44.681706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:44.681706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:44.681706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 254/520] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:44.681706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.759372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb48506-57d2-4972-a0fc-3bdf15182b20 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.803799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.805027 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.805464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.806527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.826978 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.829275 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.833898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.838534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641870cf-856d-4a1f-95ef-c995092751b8 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:44.851954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:44.853052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:44.854077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:44.854077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:44.854077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:44.854077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:44.855724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 267/521] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:44.856713 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:44.861400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:44.891592 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:44.892638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:44.893048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:44.893199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:44.893944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:44.894247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:44.895846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:44.918102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 255/522] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:44.921367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.000834 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e45e707-4484-4639-9407-6997f3ee2baa None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.052391 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.053147 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.053426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.053702 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.054492 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.054774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.056207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.077665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 268/523] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:45.077665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.089512 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d206886-35ad-4aae-958c-a82cc442ee15 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.125001 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.125820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.126121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.126393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.127167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.127584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.128881 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.151427 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 256/524] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:44 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:45.151427 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.185915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.186509 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.262729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af74aa-5e15-4d2f-b810-f050f6b989df None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.291641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44258f1-67e4-458a-af48-bccc496bd6be None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.330296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.331515 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.332167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.332691 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.334359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=54ea2fbc34f9488e8a431acf95db792f) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.334907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.337668 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.344441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.345286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.345603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.345872 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.359708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 269/525] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/role_assignments?user.id=54ea2fbc34f9488e8a431acf95db792f&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 260 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:45.359708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.368063 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.370761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:45.399161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:45.400321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:45.401804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:45.406614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 257/526] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:45.407797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.561526 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.569487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79549-7f0f-477f-9883-80915c72baaf None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.590260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e094fbf-da55-4b6a-b5c9-0c52bcd67ace None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.618122 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:45.637271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.638679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.639145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.639605 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.640412 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.641600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.642102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.642616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.643796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.644336 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.646254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.656628 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.659651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.663730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 258/527] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:45.674109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:45.687795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:45.689617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:45.691344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 270/528] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:45.700834 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:45.924761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2380d1a-9b31-49c3-b57f-f50378dd34bf None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.951171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd24951-d49d-4bca-b288-3e7ebf628c4b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:45.969815 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:45.971374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:45.972002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:45.972472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:45.973499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=6577ca8406124b4b9573937f8eea489d) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:45.974542 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:45.976898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:45.987617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 259/529] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/role_assignments?user.id=6577ca8406124b4b9573937f8eea489d&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 260 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:46.026617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.028150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.028803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.029468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.031182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:46.031956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.035061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0810f-b75c-4972-a0e8-5b43e0695f7a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.061191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 271/530] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:46.072665 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.077023 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.257728 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ec9b0-2e2e-4e29-a837-246cb5582261 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.323067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.324172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.324662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.325155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.326707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=8186eb68ef564b31909d3e7495c3f544) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:46.327266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:46.329988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbcb94-146f-471a-8231-0a755624736a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:46.341012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 260/531] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/role_assignments?user.id=8186eb68ef564b31909d3e7495c3f544&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:46.511624 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2ac2-4782-44d9-84df-a4a94550fe30 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.512207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2ac2-4782-44d9-84df-a4a94550fe30 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.512741 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae2ac2-4782-44d9-84df-a4a94550fe30 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.516593 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 272/532] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:46 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:46.531996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.532470 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.533022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.559200 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:46.560844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:46.641184 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.651827 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 261/533] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:46 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:46.672056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2ac2-4782-44d9-84df-a4a94550fe30 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:46.771897 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:46.867728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae2ac2-4782-44d9-84df-a4a94550fe30 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:46.909146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:46.910198 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:46.910502 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:46.910756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:46.925059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:46.933030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:46.935592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:46.937217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 273/534] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:46.942671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.097369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a43ff3-4018-4c26-8125-4552b99f44eb None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.166982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.168107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.168586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.169066 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.170480 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] RBAC: Adding query filter params (name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:47.171016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.173705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.190707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 262/535] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:46 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:47.200618 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.349347 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955be80-32a8-4083-b43a-65cf8463e0d1 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.358188 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.404864 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.406164 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.406597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.407028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.430523 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.432968 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:47.464783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:47.466908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:47.469103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:47.469103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:47.469103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:47.469103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:47.469103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 274/536] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:47.477435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.560039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:47.625571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01fde8a-1c2b-4db5-aa97-61f52fa9996d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.667517 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.668470 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.668765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.669049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.669790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:47.670147 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.672499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.690346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 263/537] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:47.702694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:47.844426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364227c8-c317-42f2-9851-dcdd559eaf79 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:47.891155 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:47.891974 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:47.892426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:47.892692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:47.901560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:47.903027 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:47.919704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:47.920780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:47.922125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 275/538] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:47.927429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.133280 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c70eba-dfae-4240-bc13-e4824645b5af None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:48.156838 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:48.174499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:48.175194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.175558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.175845 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.176690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:48.176999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:48.178471 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b442116-771d-4bce-abcb-c4ef72e207db None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:48.198260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 264/539] 10.222.0.112 () {56 vars in 1142 bytes} [Mon Jul 25 19:06:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:48.205954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.259784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1f44-4a0d-485a-b9b2-be5f778aed6d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.260246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1f44-4a0d-485a-b9b2-be5f778aed6d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.260652 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdc1f44-4a0d-485a-b9b2-be5f778aed6d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.261213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:48.266137 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 265/540] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:48 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:48.276654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.277167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.277573 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.307038 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:48.309332 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:48.355964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa82677-dacb-4fd2-a8f6-9c4eb4ee7c50 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:48.405751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:48.406646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.406992 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.407561 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.419573 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 266/541] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:48 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:48.424290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:48.425966 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:48.441313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:48.444290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:48.445143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:48.446243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:48.446243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:48.446243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:48.446243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:48.446243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 276/542] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:48.452386 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.576353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e2d0a4-be9d-4c99-9aa0-6d6373705ba5 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:48.581765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:48.590221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:48.599031 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cb29c0-be4e-487f-89fa-b7f3a1d4dbb6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:48.626875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:48.628303 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.628895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.629475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.659717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:48.666920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:48.667907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.668256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.668608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:48.668720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:48.670443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:48.671327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 267/543] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:48.672047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:48.672047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:48.674815 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:48.676141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.694134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 277/544] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:48.701350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.832371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d34610f-b44b-423c-8054-85fb2da43a2c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:48.842942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498bbb0b-1399-4738-9fcc-c5bffe0ffc51 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:48.876215 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:48.884574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:48.885759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.886355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.886826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.887140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:48.887966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:48.888341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:48.888636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:48.889402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] RBAC: Adding query filter params (name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:48.889923 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:48.892739 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:48.897021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:48.898758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:48.914041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:48.914931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:48.915835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:48.916244 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 268/545] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:48.917857 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.923142 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 278/546] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:48.926750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:48.969749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.051060 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f6dae-ac99-4da9-a663-b8b33184dfaf None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.078218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c077c8-8a2b-44d2-a4f7-025ccc988fcd None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.088432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.089250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.089535 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.089814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.101919 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:49.103425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:49.120330 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.121370 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.121848 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:49.122141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:49.122955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:49.123863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:49.123863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:49.123863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:49.123863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:49.123863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 269/547] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:49.124896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.125993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:49.126719 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:49.128578 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:49.129272 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.153507 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 279/548] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:49.160060 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.230896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.235036 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.266937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351400e0-3bfe-4e95-9040-a6841023e5cc None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.290258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2846469-569f-4423-bde6-609133e4fdf5 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.309900 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.310952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.311446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.311832 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.312726 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:49.313156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:49.314737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dc4ac8-9dc5-46ed-a5f8-920be0e88684 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:49.331773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5689ba-ef33-4b82-ab3b-ce5e63be4849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.332786 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 270/549] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:49.333043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5689ba-ef33-4b82-ab3b-ce5e63be4849 None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.333511 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5689ba-ef33-4b82-ab3b-ce5e63be4849 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.333889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5689ba-ef33-4b82-ab3b-ce5e63be4849 None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/fbb8bab39c68414b8db430d75072f892/roles/bcef782da7a3440d9bf6dadde1600113` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.334263 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840030fb-b156-48fc-84f9-0beb84ea8c39 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.334501 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840030fb-b156-48fc-84f9-0beb84ea8c39 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.334782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840030fb-b156-48fc-84f9-0beb84ea8c39 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.336213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 271/550] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:49.338591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a294d07-3fb5-417e-b8b5-c3998a8a7ece None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.338891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a294d07-3fb5-417e-b8b5-c3998a8a7ece None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.339183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a294d07-3fb5-417e-b8b5-c3998a8a7ece None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.340523 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 272/551] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:49 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:49.341217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a294d07-3fb5-417e-b8b5-c3998a8a7ece None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.356430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5689ba-ef33-4b82-ab3b-ce5e63be4849 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=fbb8bab39c68414b8db430d75072f892, role_id=bcef782da7a3440d9bf6dadde1600113)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:49.358785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5689ba-ef33-4b82-ab3b-ce5e63be4849 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:49.377273 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 280/552] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:49 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/fbb8bab39c68414b8db430d75072f892/roles/bcef782da7a3440d9bf6dadde1600113 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:06:49.380972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de12e-9410-450d-be69-3ab9c4d4ba80 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.381272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de12e-9410-450d-be69-3ab9c4d4ba80 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.381559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54de12e-9410-450d-be69-3ab9c4d4ba80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.410007 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-b54de12e-9410-450d-be69-3ab9c4d4ba80 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:49.411842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-b54de12e-9410-450d-be69-3ab9c4d4ba80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:49.501183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a294d07-3fb5-417e-b8b5-c3998a8a7ece None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.507719 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 281/553] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:49.508863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.509156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.509416 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.533206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:49.534767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:49.558531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.559529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.559816 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.560217 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.569694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:49.571196 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:49.576508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:49.590578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:49.591760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:49.593099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:49.595179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 273/554] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:49.596196 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.602859 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.651444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 282/555] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:49 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:49.651444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.741933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063e752-0fec-44ab-985b-20b6ce90e861 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.784267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.785660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.786196 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.786675 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.796733 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78be927-9de1-4a1a-bb79-ca980cdc0da9 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:49.806445 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:49.816490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:49.817516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:49.818355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:49.823588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 274/556] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:49.824682 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.847372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:49.848090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:49.848381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:49.848657 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:49.849522 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:49.849835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:49.851293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:49.873084 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 283/557] 10.222.0.112 () {56 vars in 1142 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:49.874527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:49.899638 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.929737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:49.984647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf14160-0ea8-432b-b9e4-ddae5fdd22e3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.027143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a60a0-e35f-4d22-9682-5f48fcaf9761 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.036170 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.037408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.037761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.038197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.066379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:50.073771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.074670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.075088 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.075572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.076464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.076907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.078513 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:50.081078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.082146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:50.083186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:50.090149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 275/558] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:50.091642 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.092549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 284/559] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:49 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.093575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.228462 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d262f5-b027-45b9-9c98-1c113dd9fc17 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.235312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.260714 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.266813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d9bfc-6e62-4eda-a23f-089b2018a5bd None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.284010 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.285229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.285684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.286143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.302502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.304905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.305311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.306296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.306719 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.307140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.308067 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.308529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.310015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.322058 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 285/560] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.323041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:50.334162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.335243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.336289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:50.336289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:50.336289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.336289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:50.336810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 276/561] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:50.337666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.462909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed56e0-4e41-42c3-82a5-1d2c785fc442 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.468144 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba88921-570e-49fd-b882-c05f15807128 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.513715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.514554 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.514935 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.515292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.517128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.518161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.518623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.519004 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.528416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.530260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.531211 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.532769 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.534584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:50.552808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.560363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.561791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:50.561791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:50.561791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.561791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:50.562163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:50.571941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:50.573697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:50.573697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:50.573697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:50.573697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:50.574176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 286/562] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:50.574176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.574356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 277/563] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:50.574356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.603504 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.717583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28045b0-3c66-461d-af6d-1f7d78cb12e5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.728483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6116e-3096-4a1c-aeef-b72b35ef8c23 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.773572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.774442 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.774861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.775022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:50.775330 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.776005 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:50.776343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.776559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:50.776867 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.777019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:50.778221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:50.778593 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.778751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:50.780596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:50.797072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 287/564] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.797974 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.805950 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 278/565] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:50.807800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:50.887619 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.924591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:50.951535 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12744351-60a9-4494-a59d-fa8e753eb538 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:50.956105 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b56a969-3b55-4e18-8526-012c126f666a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.000107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.001484 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.001484 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.001484 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.004453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.004453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.004453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.010805 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.011661 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.012033 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.013052 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.021530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 288/566] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:51.022262 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.026278 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.029645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:51.057190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:51.058787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:51.059981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:51.066936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 279/567] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:51.068968 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.183889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb71ef-ba61-4ba7-a918-35fa1b4679d1 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.207738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.231495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ef9633-253a-4fc8-bfd4-2f779056dbf0 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.235520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.236473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.236874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.237299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.248432 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.251509 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:51.272898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:51.280718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 289/568] 10.222.0.112 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:51.282525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.296269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.297312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.297849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.298239 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.308212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.309831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:51.335762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:51.337201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 280/569] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:51.339097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.363567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.440342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1988368e-b073-4328-bbdf-96d7306cd7c4 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.491351 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.492490 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.492982 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.493477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.495102 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.495676 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.497813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.515082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce5269e-7536-4389-8d9b-3355013b80ea None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.525299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 290/570] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:51.525299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.573283 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.574384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.574734 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.575080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.576015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.576326 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.577879 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.578784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.610415 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 281/571] 10.222.0.112 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:51.611663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.690636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5623089f-8d55-41c2-8dac-133944c8adf3 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.701880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.751755 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.752841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.753284 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.753978 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.755193 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:51.755735 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.758223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.768389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32394c38-03b7-47c8-9cba-daeb529e8607 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:51.783307 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 291/572] 10.222.0.112 () {56 vars in 1144 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:51.784416 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.826116 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405d31a-1338-4f0f-b190-b27bd6e913b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:51.827160 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d31a-1338-4f0f-b190-b27bd6e913b2 None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.827587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d31a-1338-4f0f-b190-b27bd6e913b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.827906 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405d31a-1338-4f0f-b190-b27bd6e913b2 None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/54ea2fbc34f9488e8a431acf95db792f/roles/bcef782da7a3440d9bf6dadde1600113` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.847292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405d31a-1338-4f0f-b190-b27bd6e913b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=54ea2fbc34f9488e8a431acf95db792f, role_id=bcef782da7a3440d9bf6dadde1600113)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:51.848804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4405d31a-1338-4f0f-b190-b27bd6e913b2 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:51.865587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 282/573] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:51 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/54ea2fbc34f9488e8a431acf95db792f/roles/bcef782da7a3440d9bf6dadde1600113 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:51.866996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb7186-35bb-476a-9554-240d0ecf3d12 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:51.867294 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb7186-35bb-476a-9554-240d0ecf3d12 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:51.867591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bb7186-35bb-476a-9554-240d0ecf3d12 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:51.869007 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 283/574] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:51.869749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb7186-35bb-476a-9554-240d0ecf3d12 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:51.941771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:51.959375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f2a2b-db3b-4f39-b350-c1abef0c3cb7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.005560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.006637 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.007118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.007644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.026620 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.028715 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:52.040337 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bb7186-35bb-476a-9554-240d0ecf3d12 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-83589757-575d-4b82-ace4-cef1ac318fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:52.055731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:52.057627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:52.059324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:52.059324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:52.059324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:52.059324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:52.063174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 292/575] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:52.065216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.065508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.065786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.067659 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:52.097010 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:52.098959 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:52.102552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.103620 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.103974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.104355 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.120341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.123062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:52.152854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:52.154464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:52.156143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:52.156143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:52.156143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:52.156143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:52.156143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 284/576] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:52.156143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.230234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 293/577] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:52 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:52.232041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.309994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dc9842-70bb-4804-a672-31f51768a372 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.365395 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:52.365650 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.366394 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.366969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.367415 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.368497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:52.369143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.371796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:52.391267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 285/578] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:52.392720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.415459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11c1399-d6f2-4313-a078-e0b85aaa13c8 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.431827 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:52.478039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.479327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.479877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.480361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.481688 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:52.482237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.484780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:52.506594 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 294/579] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:52.508359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.547792 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b97ae1-4706-4e0f-8c7d-b06508be0902 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.604607 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.605967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.606449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.606933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.627980 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:52.641192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:52.642578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:52.643958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 286/580] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:52.645998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.717145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78e3f-7886-4efd-bcba-bf0797ef2eb8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.761011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.761941 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.762289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.763328 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.765161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:52.773407 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.775458 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:52.784210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:52.791806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:52.793787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:52.795808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:52.798817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 295/581] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:52.799588 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.812208 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88a7c4-6d79-4d5e-9370-01bd379cf756 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.879834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.881380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.882004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.882632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.894287 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.895969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:52.914985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:52.916177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:52.917371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:52.919239 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 287/582] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:52.920208 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:52.946929 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caad59-ec40-47f4-8f26-cd272da3f5bf None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:52.988131 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:52.988807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:52.989094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:52.989373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:52.990121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:52.990426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:52.991822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.003434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 296/583] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:53.003434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.050739 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e3e2c-4779-4f41-afdc-cecccd45d061 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.070140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:53.091070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.091797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.092082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.092459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.093472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:53.093938 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.096468 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.115202 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 288/584] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:53.117149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.130353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:53.130928 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6edc8-e913-40f9-9394-45c16eae9ba1 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.166850 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.167721 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.168076 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.168353 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.169156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:53.169468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.170911 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.185191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 297/585] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:53.187280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.274961 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a646631-e639-43f7-bff7-75934165c845 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.312316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.314033 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.314740 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.315027 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.321567 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6af8e6-4048-4509-a8b3-38915991aa09 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.330974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.333043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.342393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:53.353746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:53.355627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:53.356547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:53.356547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:53.356547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:53.356547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:53.356547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 289/586] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:53.356547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.370046 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.371281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.371781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.372197 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/8186eb68ef564b31909d3e7495c3f544/roles/bcef782da7a3440d9bf6dadde1600113` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.397123 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=8186eb68ef564b31909d3e7495c3f544, role_id=bcef782da7a3440d9bf6dadde1600113)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.398497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.413588 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 298/587] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:53 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/8186eb68ef564b31909d3e7495c3f544/roles/bcef782da7a3440d9bf6dadde1600113 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:53.414045 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.454583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:53.512331 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3e7e3-88f3-4429-9056-b04ff09fc39f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.566158 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.568202 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.569000 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.569484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/6577ca8406124b4b9573937f8eea489d/roles/bcef782da7a3440d9bf6dadde1600113` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.590669 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=6577ca8406124b4b9573937f8eea489d, role_id=bcef782da7a3440d9bf6dadde1600113)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.593381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.596600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89148ded-b9fd-462a-9378-ad8e7c8dae9c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.619429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 290/588] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:06:53 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/6577ca8406124b4b9573937f8eea489d/roles/bcef782da7a3440d9bf6dadde1600113 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:06:53.656613 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.657300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.657587 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.657862 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.658653 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:53.658965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.660656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.675599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 299/589] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:53.683229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:53.819128 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e83c6e-d68a-40ca-8c22-fc3b07c82c71 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:53.836513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:53.873526 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:53.874534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:53.874891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:53.875328 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:53.886789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:53.889004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:53.917911 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:53.920018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 25 19:06:53.922176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:53.926397 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 291/590] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:53.936570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:54.000566 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:54.144581 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529ff394-b3a8-4578-8004-7265d9bd7288 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:54.210874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:54.211954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:54.212445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:54.212933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:54.214577 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:54.215166 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:54.217920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57cf3cc-3002-4a85-adb0-6a288531d4bc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:54.254537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 300/591] 10.222.0.112 () {56 vars in 1142 bytes} [Mon Jul 25 19:06:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 374 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:54.260380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:54.367155 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded2a7-1a42-4b1e-9647-0ed880444ff7 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:54.367477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded2a7-1a42-4b1e-9647-0ed880444ff7 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:54.367751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ded2a7-1a42-4b1e-9647-0ed880444ff7 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:54.369390 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 301/592] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:06:54.374805 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:54.375090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:54.375371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:54.395764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:54.396902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2284656d-b4a1-45ef-a194-9669f8238168 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:54.397343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:54.451742 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:54.452406 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:54.452715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:54.453430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:54.491925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 302/593] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:54 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:06:54.499249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:54.517818 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:54.543708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:54.544222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:54.545926 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:54.683224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cb4d49-5d99-41b7-989d-17ae8a1e20ab None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:54.687479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 292/594] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:54 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:54.690191 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:54.736787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:54.738438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:54.738826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:54.739110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:54.758995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:54.768116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:54.769812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:54.771382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 303/595] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:54.778008 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:54.806114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:54.852486 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682ad1d7-a7c0-41a8-bfdb-6f8736185369 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:54.906577 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:54.907577 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:54.907847 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:54.908118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:54.919273 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:54.924069 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:54.926633 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:54.956313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:54.957456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:54.958534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:54.958534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:54.958534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:54.958534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:54.963610 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 293/596] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:54.964544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:54.967929 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76573933-ad4a-49a4-ae0e-b048eda9007b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.020893 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.023188 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.024006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.024625 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.026343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:55.027114 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.029831 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.048570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 304/597] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:54 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.050854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.107996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f291e-3104-4e31-ae88-ddbc85bd83a4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.141107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.166451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.167740 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.168209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.168683 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.169655 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:55.170145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.171826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.193769 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 294/598] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:54 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.203041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.215066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95016c2-3780-46d0-973b-dc8df39f542c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.257782 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.259026 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.259582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.260106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.263949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.274727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.276408 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:55.295652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:55.297417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:55.299094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:55.299094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:55.299094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:55.299094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:55.304228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 305/599] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:55.305805 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.338862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b07ba-134e-4c7a-a05c-1685902274b7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.379006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.380255 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.380718 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.381285 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.389446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.391341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:55.409042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:55.410433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:55.411598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:55.418617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 295/600] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:55.419808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.450177 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0bc65-164f-4104-ba5d-d6ffdafdce30 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.466951 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.516139 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.517368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.517885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.518315 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.519609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:55.520079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.522429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.537200 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c18ce2c-0e62-49c4-adcd-770f8ab731a7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.551572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 306/601] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.555132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.592344 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.593889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.594365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.594792 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.595866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:55.596328 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.597978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.617368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 296/602] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.618698 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:55.686771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.773764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792926f2-1356-424f-bcf9-948bedf05c7b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.797348 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:55.802462 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15be0f-1c0d-4f31-bf05-f89e72e58887 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:55.847087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.847863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.848148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.848476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.858028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.860475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:55.860711 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.861805 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:55.862251 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:55.862672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:55.863811 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=fbb8bab39c68414b8db430d75072f892) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:55.864288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:55.866021 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:55.879831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 297/603] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/role_assignments?user.id=fbb8bab39c68414b8db430d75072f892&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 610 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-2384fc53-9bef-4291-8f01-f144c94178cb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:55.887070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:55.888345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:06:55.889501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:55.895534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 307/604] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:55.898505 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.052046 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3f13ba-3cd1-4529-8ecc-72ed7e56de97 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.093076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.094125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.094553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.094972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.096011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:56.096469 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:56.098109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:56.119706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c1da1-f994-4a4c-aa47-1aadabf27206 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.120679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c1da1-f994-4a4c-aa47-1aadabf27206 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.121156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c1da1-f994-4a4c-aa47-1aadabf27206 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.121797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 298/605] 10.222.0.112 () {56 vars in 1142 bytes} [Mon Jul 25 19:06:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 374 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:56.123237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 308/606] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:56 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:56.127917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.129747 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.130267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.131690 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.162984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:56.165464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.166234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:56.271287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 309/607] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:56.289301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9fb23-a961-4e7e-b29e-a34a5b4d48c3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.313015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.342831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185557d0-08c5-41c7-b980-6ae70080809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.344017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185557d0-08c5-41c7-b980-6ae70080809a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.344516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185557d0-08c5-41c7-b980-6ae70080809a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.345000 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185557d0-08c5-41c7-b980-6ae70080809a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.374263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.450749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185557d0-08c5-41c7-b980-6ae70080809a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:56.453215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185557d0-08c5-41c7-b980-6ae70080809a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:56.459441 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e973883-9b60-4a6d-bb20-c1bf314506ce None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.491869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.515247 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a1733-0d80-4e6c-9057-27114f3e5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.516207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1733-0d80-4e6c-9057-27114f3e5812 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.516480 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1733-0d80-4e6c-9057-27114f3e5812 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.516761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a1733-0d80-4e6c-9057-27114f3e5812 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.535667 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a1733-0d80-4e6c-9057-27114f3e5812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-fc9a1733-0d80-4e6c-9057-27114f3e5812 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:56.546159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:56.547809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:56.549256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:56.552500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 310/608] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:06:56.553925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1e9e-734f-47b4-9dfa-6ce18eff4eaa None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.554216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1e9e-734f-47b4-9dfa-6ce18eff4eaa None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.554515 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1e9e-734f-47b4-9dfa-6ce18eff4eaa None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.557291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 311/609] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:56.557291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba1e9e-734f-47b4-9dfa-6ce18eff4eaa None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.625572 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 299/610] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:56.628047 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.628495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.630125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.652107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:56.653421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:56.740106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.748032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba1e9e-734f-47b4-9dfa-6ce18eff4eaa None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.767423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 300/611] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:56 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:56.767423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.805799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.806816 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.807219 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.807667 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:56.808703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:56.808984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:56.810855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:56.826635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 312/612] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:56.827590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:56.860554 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:56.934807 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc8371d-bc83-4658-bde0-76b37806dafb None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.977404 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9b0e4-e3a4-4d0b-84ec-7a31da2537e0 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:56.991535 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:56.992362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:56.992653 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:56.992931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.008814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.010975 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.030654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.031652 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.031940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:57.032088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:57.033240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:57.034142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:57.034142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:57.034142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:57.034142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:57.034372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.034449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 301/613] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:57.034449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.050121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:06:57.058868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:57.060206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:57.061117 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 313/614] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:57.062182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.105680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.181501 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92789a8-77be-4cc8-9d33-752bccac3f80 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.187518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.221767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed47544-3166-41d1-ac15-bde84bbaeb19 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.235292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.236331 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.236906 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.237209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.254403 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.256249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.269673 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.271522 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.271891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.272369 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.273451 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:57.273976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.275955 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:57.281215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:57.282229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:57.283215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:57.283215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:57.283215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:57.283215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:57.284663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 302/615] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:57.285546 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.300254 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 314/616] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:57.300254 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.435033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.462518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ff6d85-8992-4902-9b5c-8d306703bfdb None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.471147 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c10c946-5eb5-40ff-9692-e88c4ce4e43a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.524927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.525996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.526403 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.526902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.528247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:57.528716 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.529178 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.530182 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.530627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.531067 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.531171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.532450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:57.532930 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.535125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.551329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 303/617] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:57.551329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.564453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 315/618] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:57.564453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.590640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.699704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ae9fd-598b-4094-9c2d-095edf8b77a8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.702531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a6fc7-35db-4f91-b604-43d08e7490a1 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:57.749518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.750324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.750607 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.750883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.761484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.763070 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.767891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:57.769150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:57.769624 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:57.770085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:06:57.780963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:57.782820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:06:57.785296 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:57.790717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 304/619] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:57.791489 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.792001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.795563 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:57.798721 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:57.835354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:57.836459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:57.837878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:57.837878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:57.837878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:57.837878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:57.837878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 316/620] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:57.839838 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:57.923969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:57.950830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86018b1-9cdc-40c1-9f52-1aecb6c5d422 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.004259 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b53dc-d947-4865-aa2d-239aae74c640 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.013458 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.014918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.015506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.015887 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.028762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.031725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.052053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.053027 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:58.053227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:58.055161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:06:58.065385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:58.066028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.066028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.066028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:58.066382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 305/621] 10.222.0.112 () {56 vars in 1098 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:58.066460 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.066529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.066599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.087203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 317/622] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:06:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:58.088115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.169242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:58.214270 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb1e1c-9e84-496d-a5cf-a32cdc9a8d30 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.255600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a4239-f27b-4525-bd5b-6c53c2b3ea07 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.265005 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.265712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.265993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.266265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.266980 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:58.267281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.269401 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.277810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:58.292748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 306/623] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:58.295846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.306824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.307590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.307995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.308279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.309160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:58.309468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.311119 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.341088 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 318/624] 10.222.0.112 () {56 vars in 1138 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:58.342463 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.469942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2fe86c-0ac1-48b9-9ea7-3b0859367dd0 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.475477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a00c22-d683-4c15-9eb2-924aed0c06a4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.485035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:58.518155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.518559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.518844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.519123 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.519995 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=54ea2fbc34f9488e8a431acf95db792f) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:58.520312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.520496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.521787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.521905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.522235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.522689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.529132 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 307/625] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/role_assignments?user.id=54ea2fbc34f9488e8a431acf95db792f&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 610 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:58.529947 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.532448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.534107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-87cc8363-b78b-456f-ad5a-3e9492cbaa6c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:06:58.550600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:58.551728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:06:58.552899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 319/626] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:58.554019 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7224-d76b-4115-b37a-9f8f9b100cb6 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.554019 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7224-d76b-4115-b37a-9f8f9b100cb6 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.554257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eec7224-d76b-4115-b37a-9f8f9b100cb6 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.561476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 320/627] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:06:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:06:58.561476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7224-d76b-4115-b37a-9f8f9b100cb6 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:58.659596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:58.725377 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ad6fd7-958c-4117-aff1-db66ef5bfa59 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.774728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eec7224-d76b-4115-b37a-9f8f9b100cb6 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:58.794602 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.794602 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.794602 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.794602 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.856916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:58.857646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.857925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.858199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.859431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:58.860045 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.861677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4c3e9d-5229-4fb9-9b99-2e4b57372cfd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.898858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 321/628] 10.222.0.112 () {56 vars in 1144 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 376 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:06:58.900498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:58.900498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:58.900498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:58.928146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:06:58.931868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:06:58.937630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:58.940530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:58.972973 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.059705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.075438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 322/629] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:06:58 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:06:59.075438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.134623 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 308/630] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:58 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:59.136634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.250111 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8256c3-82ed-4de3-b53c-4c136d010329 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.309234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.310290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.310290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.310599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.319712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e9e8e-607b-4559-bc6e-db0630a98c7a None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.366019 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.394242 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.395135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.395479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.395761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] PATH_INFO: `/v3/services/image` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.396499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.397923 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:59.413898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:59.416035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:59.418293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 309/631] 10.222.0.112 () {56 vars in 1110 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/services/image => generated 86 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:59.420638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.456264 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.458712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.458989 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.559956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae11889-4f02-4d51-b0d3-87a3dff9b0a6 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.605995 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.613502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.613502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.613863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 323/632] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/auth/tokens => generated 800 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 25 19:06:59.614020 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.614162 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.632694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.635354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:59.667067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:59.668234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:59.669155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:59.669155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:59.669155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:59.669155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:59.669155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 310/633] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:59.670384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.682925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.739816 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744082e5-b427-4707-88e2-71e2ce65f250 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.774870 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.782791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.783550 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.783838 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.784122 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.784861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] RBAC: Adding query filter params (name=image) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:59.785198 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.786901 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.792322 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 324/634] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/services?name=image => generated 123 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:59.793355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.820013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb82f74-69e0-4f3c-859c-a134b58d8767 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.863616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.864649 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.864943 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.865334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.877790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.879626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:06:59.898776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:06:59.907844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:06:59.909840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:06:59.909840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:06:59.909840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:06:59.909840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:06:59.909840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 311/635] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:06:59.909840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:06:59.927339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0b8064-54ee-4465-b3eb-9f135f095c4f None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:06:59.957054 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:06:59.972826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:06:59.974011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:06:59.974308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:06:59.974590 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:06:59.975342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:06:59.975671 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:06:59.977069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:06:59.990200 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 325/636] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:06:59.991156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.038821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350a763-b0e4-4f47-9ac4-46735e6f5ce5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.078393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:00.088245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.089304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.089762 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.090210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.091445 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] RBAC: Adding query filter params (type=image) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:00.091950 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.094259 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.115516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 312/637] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/services?type=image => generated 123 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:00.115516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.155972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcad3aa-c69c-4063-88b7-1f23f0631c86 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.213499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.214527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.214954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.215352 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.216565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:00.217068 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.219730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.242069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 326/638] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:06:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:00.260595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.282511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c9241-7a59-46d7-8465-c5873df22462 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.323207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:00.352709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.353540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.353829 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.354104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.364281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.366177 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:07:00.384662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:00.386009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:00.387185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 313/639] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:00.392759 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.418528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2817ee-cf5c-4c5b-a12b-5919f19d6e6f None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.470560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.471751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.472487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.472951 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.474927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:00.484444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.487781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:07:00.508998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:00.510250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:00.511632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:00.513867 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 327/640] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:00.523592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.553197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e39388-e20e-468a-a419-742b71e00947 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.606385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.607931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.608458 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.608936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.609969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:00.610484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.612790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.636841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 314/641] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:00.647093 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.655324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49427374-04b5-4e92-9ed9-a6b104663e50 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.657764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:00.720981 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.722738 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.723703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.724954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.726677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:00.728373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.732645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.756888 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 328/642] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:00.763172 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:00.814133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba701c9-1271-45e1-be08-6563b6844cc8 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.840022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:00.881502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.882959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.883702 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.884421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.886179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=8186eb68ef564b31909d3e7495c3f544) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:00.887078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.889937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c955b531-6fa6-46c9-811c-85653a5f67d6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:00.901734 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 315/643] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:00 2022] GET /identity/v3/role_assignments?user.id=8186eb68ef564b31909d3e7495c3f544&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 610 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:00.945482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bd7ec-b915-4cc1-b7f1-7a21d733d559 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:00.991500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:00.992772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:00.993288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:00.993787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:00.994860 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=6577ca8406124b4b9573937f8eea489d) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:00.995430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:00.997223 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6ca03a-681d-4275-8ef5-b71413324b39 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:01.007557 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 329/644] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:00 2022] GET /identity/v3/role_assignments?user.id=6577ca8406124b4b9573937f8eea489d&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 610 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:01.605633 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff2ce-4b41-4de8-8580-c8fe8134e274 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.606031 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff2ce-4b41-4de8-8580-c8fe8134e274 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.606216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08ff2ce-4b41-4de8-8580-c8fe8134e274 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.607982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 316/645] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:01 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:01.613675 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.614215 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.614473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.635015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:01.636402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:01.662951 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:01.721019 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 330/646] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:01 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:07:01.748129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ff2ce-4b41-4de8-8580-c8fe8134e274 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:01.879597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08ff2ce-4b41-4de8-8580-c8fe8134e274 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:01.922825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:01.923718 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:01.924006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:01.924315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:01.924986 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:01.926855 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:01.941417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:01.942939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:01.944949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 317/647] 10.222.0.112 () {56 vars in 1134 bytes} [Mon Jul 25 19:07:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:01.951070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:02.101454 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb905f8-1637-4a01-8cdc-c694291d61fd None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:02.152761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:02.153359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.153636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.153916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.154635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:02.154943 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:02.156430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314d0119-5197-479a-91e3-6a194876e3ac None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:02.162205 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 331/648] 10.222.0.112 () {56 vars in 1129 bytes} [Mon Jul 25 19:07:01 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:02.169074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:02.260299 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:02.363801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99e96aa-999e-4b2f-b374-402bfa4b47bd None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:02.419098 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:02.420200 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.420634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.421053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.422332 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:02.422812 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:02.424969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a33ebf4-ceea-420b-95a5-55967218dd70 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:02.433068 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 318/649] 10.222.0.112 () {56 vars in 1129 bytes} [Mon Jul 25 19:07:02 2022] GET /identity/v3/services?type=block-storage => generated 131 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:02.826932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3febf-7100-4f80-bd7b-ed75f29ef631 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.827526 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3febf-7100-4f80-bd7b-ed75f29ef631 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.827526 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e3febf-7100-4f80-bd7b-ed75f29ef631 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.829227 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 332/650] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:02.835168 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba74fd-4bf6-4729-a1dc-9a7d0651d813 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:02.835783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba74fd-4bf6-4729-a1dc-9a7d0651d813 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:02.835783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba74fd-4bf6-4729-a1dc-9a7d0651d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:02.856634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c2ba74fd-4bf6-4729-a1dc-9a7d0651d813 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:02.857904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c2ba74fd-4bf6-4729-a1dc-9a7d0651d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:02.936757 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 319/651] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:02 2022] POST /identity/v3/auth/tokens => generated 800 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:07:02.965508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3febf-7100-4f80-bd7b-ed75f29ef631 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:02.994232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:03.093134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e3febf-7100-4f80-bd7b-ed75f29ef631 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:03.146553 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9149b-5422-444f-ab69-ceafe74b141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:03.148043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9149b-5422-444f-ab69-ceafe74b141c None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.148470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9149b-5422-444f-ab69-ceafe74b141c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.148813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9149b-5422-444f-ab69-ceafe74b141c None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.149673 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9149b-5422-444f-ab69-ceafe74b141c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:03.151541 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9149b-5422-444f-ab69-ceafe74b141c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:03.176099 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 333/652] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:02 2022] POST /identity/v3/services => generated 243 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:03.489927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3062-fe55-41f5-942d-ef9f176395ab None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.490394 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3062-fe55-41f5-942d-ef9f176395ab None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.490571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f3062-fe55-41f5-942d-ef9f176395ab None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.492229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 320/653] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:03.498319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.498657 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.498896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.519164 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:03.520441 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:03.640908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 334/654] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:03 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 25 19:07:03.665611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f3062-fe55-41f5-942d-ef9f176395ab None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:03.714453 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:03.816706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f3062-fe55-41f5-942d-ef9f176395ab None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:03.882490 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b2586-dd17-4484-84e7-7dcbab99ef10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:03.883998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2586-dd17-4484-84e7-7dcbab99ef10 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.884491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2586-dd17-4484-84e7-7dcbab99ef10 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.885076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b2586-dd17-4484-84e7-7dcbab99ef10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.906496 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b2586-dd17-4484-84e7-7dcbab99ef10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-491b2586-dd17-4484-84e7-7dcbab99ef10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:03.922959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:03.924876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:03.926103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 321/655] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:03.936570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:03.946219 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:03.950571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606914dd-e32f-4996-9633-785be8a304e8 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.951121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606914dd-e32f-4996-9633-785be8a304e8 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.951616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606914dd-e32f-4996-9633-785be8a304e8 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.954128 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 322/656] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:03 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:07:03.959381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:03.959841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:03.960213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:03.990787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:03.993158 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:04.084982 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb588e-cb83-4eef-b6a8-a1302f67af8b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.103418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 323/657] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:03 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:07:04.125809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.132872 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.133875 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.134234 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.134516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.135658 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:04.136043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.137960 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.152207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 335/658] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:03 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:04.157440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.165614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:04.256599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:04.264055 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85485383-53cf-414b-9ddc-4117225c5582 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.306531 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c740a5-f4a7-4290-8118-765ad4535b1e None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.327743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.328666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.328944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.329223 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] PATH_INFO: `/v3/services/network` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.329917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.332162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:04.349380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:04.350880 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:04.352584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 324/659] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/services/network => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:04.363453 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.371966 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.372932 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.373474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.374367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.405076 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.406595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:04.430124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:04.431687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:04.433129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:04.433129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:04.433129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:04.433129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:04.433129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 336/660] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:04.440890 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.505951 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:04.518672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b52f8b-abe5-4149-85be-2f4f9141f8af None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.570366 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.571126 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.571426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.571712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.572683 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] RBAC: Adding query filter params (name=network) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:04.573407 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.575099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.579508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e48d566-8f5a-4134-a373-ea7b5c93797d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.581562 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 325/661] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/services?name=network => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:04.587926 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.602615 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:04.625664 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.626342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.626629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.626906 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.627680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:04.628049 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.629504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.643645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 337/662] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:04.650556 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.729467 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042ace53-b59d-48e6-8c89-516559a613fb None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.769800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.770943 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.771644 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.772288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.773225 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] RBAC: Adding query filter params (type=network) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:04.773755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.775671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.781873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 326/663] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/services?type=network => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:04.782792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dc873-fb87-47ab-82f7-b2b76720651b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:04.852180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:04.853537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:04.854059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:04.854544 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:04.864911 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:04.866991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-c8eaaac6-4f79-48e2-aa5d-7270d3038da6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:07:04.884604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:04.885634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:07:04.886598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:04.893324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 338/664] 10.222.0.112 () {56 vars in 1098 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:04.896959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:04.932629 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:05.043893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32e7deb-6542-4a84-93be-58057e86a170 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:05.052447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd518-8e17-4f85-ad33-b6d13108884e None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.052961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd518-8e17-4f85-ad33-b6d13108884e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.052961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcd518-8e17-4f85-ad33-b6d13108884e None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.054545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 339/665] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:05 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:07:05.060025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.060384 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.060575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.081267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:05.082552 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:05.102575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:05.104648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.105142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.106503 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.109636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:05.110178 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:05.112797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:05.132343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:05.137689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 327/666] 10.222.0.112 () {56 vars in 1138 bytes} [Mon Jul 25 19:07:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:05.143172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:05.181053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 340/667] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:05 2022] POST /identity/v3/auth/tokens => generated 896 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 25 19:07:05.205558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:05.249338 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:05.297803 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc0b37-df47-456e-b413-65e7501aec65 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:05.353819 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f9d32b-60a2-4bb6-9fef-1c5bcf3dd99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:05.355272 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d32b-60a2-4bb6-9fef-1c5bcf3dd99a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.356309 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d32b-60a2-4bb6-9fef-1c5bcf3dd99a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.357549 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f9d32b-60a2-4bb6-9fef-1c5bcf3dd99a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.362821 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eeb6af-1c1d-4caa-aed6-c41a028699c8 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:05.415941 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:05.416748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.417041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.417294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.418604 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:05.420213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:05.447597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 341/668] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:05 2022] POST /identity/v3/services => generated 252 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:07:05.470597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d32b-60a2-4bb6-9fef-1c5bcf3dd99a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:05.472611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f9d32b-60a2-4bb6-9fef-1c5bcf3dd99a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:05.583853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:05.634897 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 328/669] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:05 2022] GET /identity/v3/auth/tokens => generated 896 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 25 19:07:05.640869 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:05.688946 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:05.786368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63c57-7058-432b-bc38-225062e0c5b5 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.787333 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63c57-7058-432b-bc38-225062e0c5b5 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.787936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd63c57-7058-432b-bc38-225062e0c5b5 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.795125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 329/670] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:05 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:05.798270 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.798878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.799426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.806279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd94f-43a6-4d8d-bed0-e097f70343cb None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:05.823968 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:05.825640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:05.856861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:05.858131 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:05.858798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:05.859466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:05.874115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:05.876365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:05.903660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:05.905171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:05.906866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:05.906866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:05.906866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:05.906866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:05.915515 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 342/671] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:05.919061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:05.948653 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 330/672] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:05 2022] POST /identity/v3/auth/tokens => generated 1000 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:05.980145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.069478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664dc56f-2ad2-419b-a29d-4b74dc307fc8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.099837 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:06.115747 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.117276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.118017 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.118749 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.120392 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:06.121243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.123857 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.136232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1673b32-7325-44eb-8b3f-3855402168ab None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.146985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 343/673] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:05 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:06.148842 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:06.149861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.192665 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.193748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.194235 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.194716 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.195799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.197726 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:06.215651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:06.218195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:06.219813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 331/674] 10.222.0.112 () {56 vars in 1110 bytes} [Mon Jul 25 19:07:05 2022] GET /identity/v3/services/image => generated 86 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:07:06.224171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.314588 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce7552-a208-41cc-b7e0-e3ed8f16ed87 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.361639 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.362450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.362733 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.363031 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.375440 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1dcdee-0818-49e1-9d52-f1f7ac4702e9 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.375649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.377070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.379294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:07:06.398709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:06.399730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:06.405956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 344/675] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:07:06.412498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.438426 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.439637 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.440278 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.441073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.442978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] RBAC: Adding query filter params (name=image) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:06.443780 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.446215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.454263 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 332/676] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:06 2022] GET /identity/v3/services?name=image => generated 123 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:06.462162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.516277 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:06.558717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79827f1-eebf-4d32-aa97-a202470fd7ad None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.617101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.617746 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216f809e-76ca-4d5e-89af-f91b9f361f09 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.619009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.620037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.621970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.623470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:06.624291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.627103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.659697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 345/677] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:07:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:06.663976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.675297 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.677734 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.678575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.679181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.681014 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] RBAC: Adding query filter params (type=image) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:06.681797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.685228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.696316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 333/678] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:06 2022] GET /identity/v3/services?type=image => generated 352 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:06.707893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:06.761959 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:06.836744 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f22a72b-df11-4951-9eee-e8261e3f5f3f None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:06.903009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:06.904287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:06.904811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:06.905474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:06.907008 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=8186eb68ef564b31909d3e7495c3f544) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:06.907689 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:06.909703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:06.919203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 346/679] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:06 2022] GET /identity/v3/role_assignments?user.id=8186eb68ef564b31909d3e7495c3f544&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:06.932596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:06.939374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192ae782-e76d-49ef-8978-6913c24da65d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:07.005233 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:07.008424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.009246 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.010033 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.011534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] RBAC: Adding query filter params (interface=public, service_id=fcb4ae87600c499faa71a328c7874519, region_id=RegionOne) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:07.012186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:07.014234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b94f38-a0f0-4fbd-a2e7-b3f7fac6b1ee None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:07.026328 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 334/680] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:07:06 2022] GET /identity/v3/endpoints?service_id=fcb4ae87600c499faa71a328c7874519&interface=public®ion_id=RegionOne => generated 195 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:07.034290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:07.188455 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488decb-11e2-43d5-bd63-3f503a2c4adc None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:07.225850 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:07.249330 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377f7b9-0cba-4111-9682-9f69ff3caf06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:07.250400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377f7b9-0cba-4111-9682-9f69ff3caf06 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.250767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377f7b9-0cba-4111-9682-9f69ff3caf06 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.251092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377f7b9-0cba-4111-9682-9f69ff3caf06 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.251836 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377f7b9-0cba-4111-9682-9f69ff3caf06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:07.253538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377f7b9-0cba-4111-9682-9f69ff3caf06 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:07.261623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 347/681] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:07:07 2022] GET /identity/v3/services => generated 778 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:07.731758 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d44f-3cb6-44c1-b4c1-e322f9ac6f0f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.732286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d44f-3cb6-44c1-b4c1-e322f9ac6f0f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.732424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae3d44f-3cb6-44c1-b4c1-e322f9ac6f0f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.735120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 335/682] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:07 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:07.741617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca724a-26a0-4a89-8578-7e8198cb0f28 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:07.742013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca724a-26a0-4a89-8578-7e8198cb0f28 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:07.742323 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ca724a-26a0-4a89-8578-7e8198cb0f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:07.766414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-75ca724a-26a0-4a89-8578-7e8198cb0f28 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:07.767750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-75ca724a-26a0-4a89-8578-7e8198cb0f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:07.894953 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 348/683] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:07 2022] POST /identity/v3/auth/tokens => generated 1000 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:07.931736 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d44f-3cb6-44c1-b4c1-e322f9ac6f0f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:08.082082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae3d44f-3cb6-44c1-b4c1-e322f9ac6f0f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:08.144889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060b5e79-dd85-4c08-a249-bf0e8e572b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:08.146506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5e79-dd85-4c08-a249-bf0e8e572b97 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:08.147269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5e79-dd85-4c08-a249-bf0e8e572b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:08.148075 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060b5e79-dd85-4c08-a249-bf0e8e572b97 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:08.149604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b5e79-dd85-4c08-a249-bf0e8e572b97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:08.152318 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060b5e79-dd85-4c08-a249-bf0e8e572b97 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:08.179783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 336/684] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:07 2022] POST /identity/v3/services => generated 241 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:07:08.413039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21417d-ef43-4153-9569-bf434a89ea7c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:08.413823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21417d-ef43-4153-9569-bf434a89ea7c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:08.413823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21417d-ef43-4153-9569-bf434a89ea7c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:08.416517 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 349/685] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:08 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:08.424955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:08.425844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:08.426542 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:08.458375 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:08.460754 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:08.490261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:08.616831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 337/686] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:08 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:07:08.645004 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21417d-ef43-4153-9569-bf434a89ea7c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:08.777101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21417d-ef43-4153-9569-bf434a89ea7c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:08.798486 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:08.838778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:08.839895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:08.840230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:08.840659 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:08.841751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:08.843797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:08.862877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:08.864584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:08.865879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 350/687] 10.222.0.112 () {56 vars in 1134 bytes} [Mon Jul 25 19:07:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:08.870605 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:09.004695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d845ac99-9c4d-4843-9913-850777116f13 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:09.047364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:09.048102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.048382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.048658 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.049479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:09.049793 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:09.051262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:09.057790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 338/688] 10.222.0.112 () {56 vars in 1129 bytes} [Mon Jul 25 19:07:08 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:09.065582 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:09.190645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b64fa0-ecb3-4d4d-a547-920b4be597ed None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:09.229529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:09.230203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.230482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.230760 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.231499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:09.231804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:09.233231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:09.240507 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 351/689] 10.222.0.112 () {56 vars in 1129 bytes} [Mon Jul 25 19:07:09 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:09.248276 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:09.275350 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:09.400586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d585a68-aa1b-4303-9b7c-6c6679cf2c4b None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:09.442351 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:09.443017 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.443445 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.443750 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.444550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] RBAC: Adding query filter params (interface=public, service_id=4260c70fc8c142e8a03c2e44b2a0bf43, region_id=RegionOne) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:09.444861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:09.446261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe67fa0-81e6-4570-975d-5ab897d171f6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:09.452719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 339/690] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:07:09 2022] GET /identity/v3/endpoints?service_id=4260c70fc8c142e8a03c2e44b2a0bf43&interface=public®ion_id=RegionOne => generated 195 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:09.458285 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:09.515228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:09.595727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d3df9-f350-4d45-9baa-6473c4b09e10 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:09.644230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cbe4f9-2c44-49d3-b5cd-4fe86c69c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:09.645020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe4f9-2c44-49d3-b5cd-4fe86c69c8ed None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.645367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe4f9-2c44-49d3-b5cd-4fe86c69c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.645651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cbe4f9-2c44-49d3-b5cd-4fe86c69c8ed None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.646361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbe4f9-2c44-49d3-b5cd-4fe86c69c8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:09.647938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cbe4f9-2c44-49d3-b5cd-4fe86c69c8ed None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:09.654792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 352/691] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:07:09 2022] GET /identity/v3/services => generated 1007 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:07:09.769844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2c6e4-300f-4b80-82f9-cf62d4a6c0ac None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.770266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2c6e4-300f-4b80-82f9-cf62d4a6c0ac None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.770457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2c6e4-300f-4b80-82f9-cf62d4a6c0ac None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.772931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 340/692] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:09.779534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500799d8-2baf-4fc2-aa51-568d941b4506 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:09.779825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500799d8-2baf-4fc2-aa51-568d941b4506 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:09.780151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500799d8-2baf-4fc2-aa51-568d941b4506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:09.801393 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-500799d8-2baf-4fc2-aa51-568d941b4506 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:09.802624 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-500799d8-2baf-4fc2-aa51-568d941b4506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:09.912294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 353/693] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:09 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:09.942232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2c6e4-300f-4b80-82f9-cf62d4a6c0ac None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.033630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.067971 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2c6e4-300f-4b80-82f9-cf62d4a6c0ac None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.072133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b28c-cfc4-4407-acbb-3db6a8db4cd1 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.072865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b28c-cfc4-4407-acbb-3db6a8db4cd1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.073513 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903b28c-cfc4-4407-acbb-3db6a8db4cd1 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.075924 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 354/694] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:10.081453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.082005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.082637 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.106887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:10.109224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:10.111654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.113045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.113329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.113614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.128823 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:10.139199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:10.140389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:10.141288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 341/695] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:10.148989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.168445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.280537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 355/696] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:10 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:07:10.314284 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.318356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849f30dc-a417-4534-a790-92e86c75ebdd None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.375752 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.376442 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.376722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.377002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.377770 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:10.378075 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.379938 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.383144 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.398320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 342/697] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:10.399889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.555221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4698d4-055d-4d63-949c-e3246a58dd21 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.609898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.611141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.611675 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.612163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.640167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.640510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61838e2-0ad8-47c4-bac8-a63837824482 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.643261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.688482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.689502 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.689818 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.690073 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] PATH_INFO: `/v3/services/image` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.690727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.692527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:10.707699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:10.709417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 25 19:07:10.710312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:10.714597 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 356/698] 10.222.0.112 () {56 vars in 1110 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/services/image => generated 86 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:10.716724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:10.718286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:10.719985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:10.721323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:10.721323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:10.721323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:10.721323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:10.726831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 343/699] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:10.733316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:10.809298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.852358 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:10.912683 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9aa42e-5a25-4a1d-9bab-b6d0734d59c9 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.920132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20614772-cd66-47a1-a9db-ec088601c56c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:10.963611 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.964640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.965118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.965414 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.965807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:10.966657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:10.967061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.967485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.967857 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.968143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.968872 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] RBAC: Adding query filter params (name=image) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:10.969181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:10.970150 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.970549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd586f8-c3e2-4c5a-99c9-a582b4b117d7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:10.991562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 357/700] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/services?name=image => generated 123 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:10.991562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c09a-7059-4373-a747-064a66213599 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.991562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c09a-7059-4373-a747-064a66213599 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.991562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282c09a-7059-4373-a747-064a66213599 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.991562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 358/701] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:10.992189 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 344/702] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:10.992286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:10.992286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:10.992286 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:10.995660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.017574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:11.019528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:11.130433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 359/703] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:10 2022] POST /identity/v3/auth/tokens => generated 1099 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:11.131798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.162892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7af6dd-ec85-4aa9-98fc-dd41ef31288f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.179212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.179751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.217551 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.218615 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.219016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.219314 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.230931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.233163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:07:11.257198 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:11.260423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 345/704] 10.222.0.112 () {56 vars in 1098 bytes} [Mon Jul 25 19:07:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:11.261404 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.281133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b8b208-305d-43ec-9285-da99b64f766f None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.327177 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.328004 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.328308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.328593 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.329322 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] RBAC: Adding query filter params (type=image) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:11.329629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.331055 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.342231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 360/705] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/services?type=image => generated 352 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:11.342231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.416144 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a788e3f6-fd46-45e0-a762-91d922d6491c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.465261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.466540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.466989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.467759 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] PATH_INFO: `/v3/services/network` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.468901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.470500 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.479548 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:11.485999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:11.487340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:11.489016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 346/706] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:11.490614 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.500562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403d1d58-38ae-4703-a73a-de3cf196dad6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.554378 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.555841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.556315 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.556783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.558551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:11.558857 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.559111 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.562591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.587481 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 361/707] 10.222.0.112 () {56 vars in 1138 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:11.587481 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.673259 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95705d-8b78-4ab9-953c-9e687b504eed None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.724371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.726075 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.726559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.727065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.728424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.731131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.737890 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8333386b-a7d5-43fb-adf8-c243ca50905a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.775435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 347/708] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:07:11 2022] POST /identity/v3/endpoints => generated 329 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:11.775435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.800768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:11.801571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:11.801861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:11.802230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:11.803055 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] RBAC: Adding query filter params (name=network) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:11.803442 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:11.805304 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:11.815279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 362/709] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/services?name=network => generated 125 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:11.825583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:11.848142 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.937790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:11.956743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae887c-99aa-4a0f-901c-9e4a30b7bb1f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:11.979894 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6898df-ec0a-49f4-bd86-d667e5aa9877 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.003223 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.005185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.005185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.005185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.020660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.022313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.040491 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.041765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.042298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.042810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.043848 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] RBAC: Adding query filter params (type=network) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:12.044355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.046124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:12.048764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:12.050236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:12.051156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:12.051156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:12.051156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:12.051156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:12.051156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 348/710] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:12.057833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.058898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 363/711] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:11 2022] GET /identity/v3/services?type=network => generated 352 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:12.065575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.161351 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.195053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e2a3b-2d56-4662-8d0b-b468fa41d5c6 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.201018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14a66d-50b9-4a32-9fde-dfa3d4d26e60 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.236006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.237073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.237558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.238014 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.238963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:12.239853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.242172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.263128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.263128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.263128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.263128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.263629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] RBAC: Adding query filter params (interface=public, service_id=ae23db5d37cc4b018579d0d3b8db82ea, region_id=RegionOne) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:12.263629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.264129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 349/712] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:12.264551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.265555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.269118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.284165 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 364/713] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/endpoints?service_id=ae23db5d37cc4b018579d0d3b8db82ea&interface=public®ion_id=RegionOne => generated 195 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:12.285373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.436409 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f43b2a7-853d-4493-9a22-10d933b62188 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.445418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098a41b-cc8c-408f-808d-18e92448272b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.486082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.487249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.487765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.488232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.496850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.498604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.501997 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1176818-0590-4780-ac26-2aab7e1fc2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.502955 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1176818-0590-4780-ac26-2aab7e1fc2f1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.503459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1176818-0590-4780-ac26-2aab7e1fc2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.503953 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1176818-0590-4780-ac26-2aab7e1fc2f1 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.505171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1176818-0590-4780-ac26-2aab7e1fc2f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.507542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1176818-0590-4780-ac26-2aab7e1fc2f1 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.510483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:07:12.517970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:12.519154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:12.520179 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:12.522220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 350/714] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:12.523834 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 365/715] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/services => generated 1007 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:07:12.533256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.542692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9cc84-62cf-4316-85fc-d0ceda38c07d None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.542921 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9cc84-62cf-4316-85fc-d0ceda38c07d None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.543212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef9cc84-62cf-4316-85fc-d0ceda38c07d None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.545140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 366/716] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:07:12.554488 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.555583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.555583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.578195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:12.579831 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:12.628312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.677814 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 367/717] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:12 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:07:12.692126 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327dcc12-b4d5-45b7-b05b-7f789d2e3347 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.711073 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.747181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.747890 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.748166 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.748467 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.749441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:12.750166 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.751229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.766059 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 351/718] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:12.773576 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:12.915949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf4376-8326-4e89-b604-749762ea9cc8 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.920106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fcb71-c4bc-4ba4-8e89-81e191fafcad None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:12.967829 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.979956 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:12.985468 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.986901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.987428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.987918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/8186eb68ef564b31909d3e7495c3f544/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.990151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:12.991202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:12.991709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:12.992134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:12.992450 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=8186eb68ef564b31909d3e7495c3f544, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.993365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:12.994851 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:12.996390 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:13.019618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 352/719] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:07:12 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/8186eb68ef564b31909d3e7495c3f544/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:13.024727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:13.025777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 25 19:07:13.026631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:13.028263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 368/720] 10.222.0.112 () {56 vars in 1134 bytes} [Mon Jul 25 19:07:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:13.034826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:13.178940 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4c710b-a2fd-427c-959c-0f87860c2bdb None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:13.248175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:13.249240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.249701 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.250238 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.251550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:13.252085 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:13.254621 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:13.265226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 353/721] 10.222.0.112 () {56 vars in 1129 bytes} [Mon Jul 25 19:07:13 2022] GET /identity/v3/services?name=block-storage => generated 131 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:13.271616 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:13.414196 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d439b6-16f8-4079-a745-fa5d4bd66dd8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:13.455233 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:13.455943 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.456228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.456512 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.457232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:13.457541 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:13.459259 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded1e865-c9d5-425b-9fa5-f60394b350bb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:13.466822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 369/722] 10.222.0.112 () {56 vars in 1129 bytes} [Mon Jul 25 19:07:13 2022] GET /identity/v3/services?type=block-storage => generated 369 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:13.475136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:13.540357 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:13.612408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b48dae-8fcd-4aef-81cc-085033a489cb None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:13.653581 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f7c36-83f5-4a2d-9f6f-a20d035b9c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:13.654282 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7c36-83f5-4a2d-9f6f-a20d035b9c90 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:13.654666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7c36-83f5-4a2d-9f6f-a20d035b9c90 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:13.654913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f7c36-83f5-4a2d-9f6f-a20d035b9c90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:13.655705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7c36-83f5-4a2d-9f6f-a20d035b9c90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:13.657097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f7c36-83f5-4a2d-9f6f-a20d035b9c90 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:13.685571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 354/723] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:07:13 2022] POST /identity/v3/endpoints => generated 348 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:07:14.657858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb447da-5faa-4276-acac-d28febef24c1 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:14.658398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb447da-5faa-4276-acac-d28febef24c1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:14.658398 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb447da-5faa-4276-acac-d28febef24c1 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:14.660177 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 370/724] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:14 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:14.665968 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:14.666583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:14.666583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:14.686141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:14.687356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:14.766807 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 355/725] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:14 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:07:14.791034 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb447da-5faa-4276-acac-d28febef24c1 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:14.859853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:14.903120 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb447da-5faa-4276-acac-d28febef24c1 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:14.941835 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91162814-be6a-4c39-ab94-c7ba93b59a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:14.942577 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162814-be6a-4c39-ab94-c7ba93b59a7f None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:14.942868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162814-be6a-4c39-ab94-c7ba93b59a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:14.943150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91162814-be6a-4c39-ab94-c7ba93b59a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.035186 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162814-be6a-4c39-ab94-c7ba93b59a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:15.036708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91162814-be6a-4c39-ab94-c7ba93b59a7f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:15.102152 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:15.153095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 371/726] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:14 2022] GET /identity/v3/auth/tokens => generated 1249 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:15.159745 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:15.191334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:15.270802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f85c3c-130d-428a-8c81-9859caedcfe2 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:15.291331 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4370-507e-4729-956a-18ead3a1918d None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.291705 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4370-507e-4729-956a-18ead3a1918d None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.291934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f4370-507e-4729-956a-18ead3a1918d None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.295473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 372/727] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:07:15.300558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.301081 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.301586 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.315260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:15.316149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.316733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.317662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.324609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:15.326804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:15.334049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:15.336792 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:15.361457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:15.362972 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:15.364806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:15.364806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:15.364806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:15.364806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:15.364806 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 356/728] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:15.369856 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:15.443526 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 373/729] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:15 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:07:15.466125 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:15.475709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:15.497645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75239c6-69b4-4cba-863d-10a06422f57e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:15.536351 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:15.537190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.537558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.537883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.538625 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:15.539351 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:15.540353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:15.559725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 357/730] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:15 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:15.595806 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:15.616540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b568f3-ea5b-4c7b-8a1f-405b6659c703 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:15.684573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:15.687358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.688278 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.689104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] PATH_INFO: `/v3/services/network` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.690666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:15.694028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-39e907e6-1230-433e-baf9-db9cb4c14d32 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:15.713670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:15.715311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 25 19:07:15.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:15.727057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 374/731] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:15 2022] GET /identity/v3/services/network => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:07:15.729068 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:15.881292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2025c-5bd7-4ed4-a8a8-c57baae91450 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.881685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2025c-5bd7-4ed4-a8a8-c57baae91450 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.881832 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2025c-5bd7-4ed4-a8a8-c57baae91450 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.883581 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 375/732] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:07:15.891248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614a771-8416-4781-9cb0-a01a33edae2b None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:15.892316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.892607 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.893111 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.927438 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:15.929706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:15.975766 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:15.976672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:15.977128 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:15.977405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:15.978131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:15.978465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:15.980277 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:15.995193 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 358/733] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:15 2022] GET /identity/v3/services?name=network => generated 125 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:15.996992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.003379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.067874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 376/734] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:15 2022] POST /identity/v3/auth/tokens => generated 1249 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:16.092755 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.165901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d193f-44ef-4fbd-b175-a1b4dadc6af8 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.223306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.224431 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.224877 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.225319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.226391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:16.227048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:16.232792 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:16.238758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.243642 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 359/735] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:15 2022] GET /identity/v3/services?type=network => generated 352 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:16.244915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.263971 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5eb8ab-df51-43c2-a9ff-e937906577f2 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.337433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.338807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.339288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.340006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.341890 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.361470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:07:16.376684 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:16.377887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:16.379804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 377/736] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:16.386889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.422629 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0597e786-03cd-4146-8dbf-d009cd1cd3a7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.480414 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ba066-6c14-467e-9df1-c9902cc07605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.480644 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba066-6c14-467e-9df1-c9902cc07605 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.480851 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba066-6c14-467e-9df1-c9902cc07605 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.481133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ba066-6c14-467e-9df1-c9902cc07605 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.481927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba066-6c14-467e-9df1-c9902cc07605 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:16.483530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ba066-6c14-467e-9df1-c9902cc07605 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:16.508495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 360/737] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:07:16 2022] POST /identity/v3/endpoints => generated 329 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:07:16.510141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646de8-de86-4ab7-833e-3244054fae3e None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.510634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646de8-de86-4ab7-833e-3244054fae3e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.511033 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96646de8-de86-4ab7-833e-3244054fae3e None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.513293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 361/738] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:16 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:16.519894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.520196 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.520557 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.548006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:16.549949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:16.558011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027db72-768a-469d-a250-cff742bf7eb1 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.626608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.627441 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.627577 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.627772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.628541 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:16.628860 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:16.630287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:16.637347 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.652037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 378/739] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:16.653917 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.664919 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 362/740] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:16 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:07:16.692436 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.785875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:16.830329 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00ad70-2462-47ed-9bd3-255d9f9756cd None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.848846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cce7ca-5f0a-4c01-8203-6a91780fe4f2 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:16.877376 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.878083 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.878361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.878630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.890590 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:16.891749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:16.892112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:16.892477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:16.892605 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:16.893540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:16.894039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:16.895413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:16.912076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:16.913850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:16.915335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 363/741] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:16.917402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:16.919707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:16.921696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:16.921696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:16.921696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:16.921696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:16.921696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 379/742] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:16.922235 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.922356 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:16.994238 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.057039 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ca6e8-9c0a-4caf-9246-4f59455b274c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.080513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41ec38f-01b9-4179-b34c-06df1b975be7 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.106281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.118026 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.119303 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.119840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.120313 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.121674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:17.122213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.124985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.132359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.133084 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.133463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.133844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.134654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:17.135081 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.136994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.149883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 364/743] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:17.150107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 380/744] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:16 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:17.151195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.158767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.282014 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22503edd-a6f1-4c99-b2ff-b9ef6561a7f6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.300214 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.303782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791cf9b9-46a1-4b93-a4d2-86151a03ac3c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.330230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638769-3096-4839-9208-916d6917c202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.331202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638769-3096-4839-9208-916d6917c202 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.331598 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638769-3096-4839-9208-916d6917c202 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.332047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2638769-3096-4839-9208-916d6917c202 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.343025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2638769-3096-4839-9208-916d6917c202 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.344826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2638769-3096-4839-9208-916d6917c202 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.361967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.362923 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.363410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.363808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.364720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:17.365312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.367401 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-e2638769-3096-4839-9208-916d6917c202 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:07:17.367842 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:17.369201 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:17.370845 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 381/745] 10.222.0.112 () {56 vars in 1098 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:17.377541 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638769-3096-4839-9208-916d6917c202 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.380106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 365/746] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/services?type=volumev3 => generated 126 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2638769-3096-4839-9208-916d6917c202 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.620279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.621094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.621464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.621824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.622761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:17.623203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.625730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:17.652303 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 382/747] 10.222.0.112 () {56 vars in 1138 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 370 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:17.659226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:17.748292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:17.844137 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e30c1ec-98fe-43d6-98e0-02d781b5a133 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:17.881430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:17.882076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:17.882354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:17.882623 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:17.990082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:17.992768 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:18.067472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:18.135311 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 366/748] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:07:17 2022] GET /identity/v3/auth/tokens => generated 1399 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:07:18.141465 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:18.175444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:18.249208 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377894a-3f8c-47ea-9627-2e1ba35f010c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:18.288280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:18.289096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:18.289382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:18.289656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:18.300355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:18.301821 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:07:18.320385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:18.321365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:18.322560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:07:18.322560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:07:18.322560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:07:18.322560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:18.322560 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 383/749] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:07:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:18.327515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:18.438812 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545b019-0316-41c8-a8d4-4558d19905f5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:18.474061 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:18.474725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:18.475043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:18.475367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:18.476227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:18.476560 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:18.477930 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:18.489600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 367/750] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:07:18 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:18.495783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:18.580512 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:18.599790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8de7ea2-485e-49db-923e-308b0fc00b69 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:18.638660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:18.639494 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:18.639778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:18.640104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:18.648023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:18.649496 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:07:18.664427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:18.665381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:18.666694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 384/751] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:18.672193 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:18.682724 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:18.788134 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3ac29-b98c-4149-926c-b177078ee173 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:18.833067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:18.833888 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:18.834143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:18.834421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:18.835214 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:18.835555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:18.837025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca83762-ff7a-412b-ac12-1ea96a7eab25 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:18.849974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 368/752] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:07:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:18.856859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:18.989036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a8b05-4c9b-4972-b51a-b56a72b65120 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:19.028889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:19.029594 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:19.029871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:19.030149 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:19.030986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=8186eb68ef564b31909d3e7495c3f544) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:19.031300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:19.032788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c501bb-1570-46b8-9b09-3c03e42cc2d2 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:19.040860 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 385/753] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:07:18 2022] GET /identity/v3/role_assignments?user.id=8186eb68ef564b31909d3e7495c3f544&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 610 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:19.886018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c977d8c-32e0-414a-aa4b-72537db2ecfd None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:19.886592 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c977d8c-32e0-414a-aa4b-72537db2ecfd None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:19.886592 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c977d8c-32e0-414a-aa4b-72537db2ecfd None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:19.888002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 369/754] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:19.893899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929b73-742c-43a7-8c3a-bfb417ced128 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:19.894414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929b73-742c-43a7-8c3a-bfb417ced128 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:19.894540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41929b73-742c-43a7-8c3a-bfb417ced128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:19.908481 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:19.914412 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-41929b73-742c-43a7-8c3a-bfb417ced128 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:19.915666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-41929b73-742c-43a7-8c3a-bfb417ced128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:19.999152 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 386/755] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:19 2022] POST /identity/v3/auth/tokens => generated 1399 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:20.024622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c977d8c-32e0-414a-aa4b-72537db2ecfd None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:20.096905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:20.136704 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c977d8c-32e0-414a-aa4b-72537db2ecfd None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:20.194778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254e4dd-64bf-418b-8fef-37650d96149b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:20.195558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254e4dd-64bf-418b-8fef-37650d96149b None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:20.195897 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254e4dd-64bf-418b-8fef-37650d96149b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:20.196189 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254e4dd-64bf-418b-8fef-37650d96149b None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:20.196982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254e4dd-64bf-418b-8fef-37650d96149b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:20.198435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1254e4dd-64bf-418b-8fef-37650d96149b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:20.227429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 370/756] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:20 2022] POST /identity/v3/services => generated 252 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:21.475122 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654460b-199d-4d9c-9d9e-44f270e945a2 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:21.475745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654460b-199d-4d9c-9d9e-44f270e945a2 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:21.475745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5654460b-199d-4d9c-9d9e-44f270e945a2 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:21.477229 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 387/757] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:21.482943 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:21.483665 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:21.483665 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:21.502334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:21.503662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:21.610840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 371/758] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:21 2022] POST /identity/v3/auth/tokens => generated 1500 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:21.634243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654460b-199d-4d9c-9d9e-44f270e945a2 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:21.749643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5654460b-199d-4d9c-9d9e-44f270e945a2 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:21.788086 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:21.788893 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:21.789169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:21.789439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:21.790093 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:21.791477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:21.794122 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:21.807133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:21.808692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:21.809576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 388/759] 10.222.0.112 () {56 vars in 1137 bytes} [Mon Jul 25 19:07:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:21.820730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:21.873722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:21.946670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e458e75-e75e-4a20-a95e-048d5fdeab26 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:21.998757 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:21.999916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.000299 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.000760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.001854 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:22.002316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:22.004488 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b7a17-7b5a-4861-b0c6-e32d935f8c82 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:22.012941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 372/760] 10.222.0.112 () {56 vars in 1131 bytes} [Mon Jul 25 19:07:21 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:22.023860 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:22.144851 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c82143-20bd-4f05-99a5-093f1fb3faa0 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:22.178833 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:22.179529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.179811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.180191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.180894 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:22.181197 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:22.182591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbe521-07e9-46d3-8754-61f312fda015 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:22.187843 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 389/761] 10.222.0.112 () {56 vars in 1131 bytes} [Mon Jul 25 19:07:22 2022] GET /identity/v3/services?type=compute_legacy => generated 132 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:22.719935 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43e48e-2b7c-4efd-99bd-4c3fa55ee93c None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.720532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43e48e-2b7c-4efd-99bd-4c3fa55ee93c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.720892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a43e48e-2b7c-4efd-99bd-4c3fa55ee93c None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.723787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 373/762] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:22 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:22.732934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:22.733464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:22.733903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:22.765959 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:22.767204 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:22.844562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:22.860940 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 390/763] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:22 2022] POST /identity/v3/auth/tokens => generated 1500 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:22.888484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43e48e-2b7c-4efd-99bd-4c3fa55ee93c None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:23.005929 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a43e48e-2b7c-4efd-99bd-4c3fa55ee93c None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:23.030940 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:23.052669 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:23.053535 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:23.053865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:23.054141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:23.054818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:23.056250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:23.069603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:23.071125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:23.072043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 374/764] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:23.077316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:23.220104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58ff344-4d5d-4fa6-8f81-d076318f6403 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:23.263809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:23.264373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:23.264649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:23.264921 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:23.265632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:23.265934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:23.267293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:23.272026 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 391/765] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:23 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:23.277901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:23.385802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67c98-f8ee-408e-8fff-79b69c5c2348 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:23.428946 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:23.429600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:23.429888 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:23.430160 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:23.430862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:23.431161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:23.432580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:23.437421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 375/766] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:23 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:23.444246 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:23.509320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:23.585399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc0295c-a258-4960-852f-e9bd84058d5d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:23.645015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:23.646233 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:23.646616 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:23.647099 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:23.648615 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] RBAC: Adding query filter params (interface=public, service_id=322a495948f44dfd8a1b06b83143a521, region_id=RegionOne) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:23.649150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:23.651844 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df843b7-d2a3-44df-be9d-04513f328624 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:23.665768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 392/767] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:07:23 2022] GET /identity/v3/endpoints?service_id=322a495948f44dfd8a1b06b83143a521&interface=public®ion_id=RegionOne => generated 195 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:23.667092 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:23.728884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:23.788445 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62638b-6132-48d6-8ffa-9415507c8ff4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:23.825598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3379b-5b36-411e-a3f9-f46d2ffafeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:23.826271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3379b-5b36-411e-a3f9-f46d2ffafeee None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:23.826548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3379b-5b36-411e-a3f9-f46d2ffafeee None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:23.826818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3379b-5b36-411e-a3f9-f46d2ffafeee None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:23.827530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3379b-5b36-411e-a3f9-f46d2ffafeee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:23.829402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3379b-5b36-411e-a3f9-f46d2ffafeee None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:23.836111 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 376/768] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:07:23 2022] GET /identity/v3/services => generated 1247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:07:24.609980 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aa0cc-f956-4800-9c52-7d12d22c7c8c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:24.610525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aa0cc-f956-4800-9c52-7d12d22c7c8c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:24.610864 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aa0cc-f956-4800-9c52-7d12d22c7c8c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:24.613191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 393/769] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:24 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:24.620820 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2332-228f-47e4-9b26-ee2fabd4b7aa None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:24.621193 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2332-228f-47e4-9b26-ee2fabd4b7aa None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:24.621550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98c2332-228f-47e4-9b26-ee2fabd4b7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:24.641133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d98c2332-228f-47e4-9b26-ee2fabd4b7aa None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:24.642330 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d98c2332-228f-47e4-9b26-ee2fabd4b7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:24.716113 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 377/770] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:24 2022] POST /identity/v3/auth/tokens => generated 1500 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:24.740134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aa0cc-f956-4800-9c52-7d12d22c7c8c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:24.868083 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aa0cc-f956-4800-9c52-7d12d22c7c8c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:24.894066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:24.907698 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a0013-fb0a-44e2-9e09-e46cf83a9eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:24.908488 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a0013-fb0a-44e2-9e09-e46cf83a9eff None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:24.908663 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a0013-fb0a-44e2-9e09-e46cf83a9eff None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:24.908936 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a0013-fb0a-44e2-9e09-e46cf83a9eff None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:24.909678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a0013-fb0a-44e2-9e09-e46cf83a9eff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:24.911033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a0013-fb0a-44e2-9e09-e46cf83a9eff None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:24.926603 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 394/771] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:24 2022] POST /identity/v3/services => generated 270 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:26.232064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbf3c-4982-4ab0-b4f1-204dc927b44f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:26.232884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbf3c-4982-4ab0-b4f1-204dc927b44f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:26.232884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ccbf3c-4982-4ab0-b4f1-204dc927b44f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:26.233965 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 378/772] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:07:26.240629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:26.241115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:26.241675 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:26.265168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:26.266501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:26.361909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 395/773] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:26 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:26.386238 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccbf3c-4982-4ab0-b4f1-204dc927b44f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:26.440123 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:26.534865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ccbf3c-4982-4ab0-b4f1-204dc927b44f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:26.587970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:26.588744 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:26.589016 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:26.589288 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:26.589937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:26.592021 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:26.604463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:26.606378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 25 19:07:26.608265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:26.610081 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 379/774] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:26.611888 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:26.722708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb64c2a-0a97-4cee-8536-9843bf6e22c1 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:26.732914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:26.771421 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:26.772559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:26.773055 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:26.773543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:26.774865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:26.775431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:26.778074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:26.787723 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 396/775] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:26 2022] GET /identity/v3/services?name=volumev3 => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:26.793390 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:26.914114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2072bcd9-8256-4b98-961a-edc5dcf275b3 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:26.915890 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:26.951795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:26.952456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:26.952737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:26.953009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:26.953709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:26.954013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:26.955436 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb30c9-ea0c-4a6b-822b-3c0557db35bd None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:26.960594 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 380/776] 10.222.0.112 () {56 vars in 1119 bytes} [Mon Jul 25 19:07:26 2022] GET /identity/v3/services?type=volumev3 => generated 364 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:26.966629 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:27.096176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b861015-1e57-41f6-b75f-773adacca6d9 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:27.156497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c918206-3b43-42df-837d-5ed8b2b9a6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:27.157634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c918206-3b43-42df-837d-5ed8b2b9a6bc None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.158090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c918206-3b43-42df-837d-5ed8b2b9a6bc None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.158511 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c918206-3b43-42df-837d-5ed8b2b9a6bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.159297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c918206-3b43-42df-837d-5ed8b2b9a6bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:27.160749 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c918206-3b43-42df-837d-5ed8b2b9a6bc None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:27.203429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 397/777] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:07:26 2022] POST /identity/v3/endpoints => generated 348 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:07:27.307600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e46b-e23c-4a37-b6dc-e900fa86576d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.308392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e46b-e23c-4a37-b6dc-e900fa86576d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.308392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5e46b-e23c-4a37-b6dc-e900fa86576d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.309605 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 381/778] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:27 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:27.317677 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.318256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.318256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.338785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:27.340096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:27.368772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:27.430425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 398/779] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:27 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:27.454950 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e46b-e23c-4a37-b6dc-e900fa86576d None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:27.601335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5e46b-e23c-4a37-b6dc-e900fa86576d None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:27.661446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:27.662774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.663260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.663792 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.664909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:27.667367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:27.684273 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:27.686446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:27.688228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 382/780] 10.222.0.112 () {56 vars in 1137 bytes} [Mon Jul 25 19:07:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:07:27.692425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:27.816057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed16c4a-630c-4b33-9b57-9b30a51512e3 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:27.862163 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:27.862841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:27.863118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:27.863410 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:27.864349 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:27.864726 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:27.866129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:27.871641 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 399/781] 10.222.0.112 () {56 vars in 1131 bytes} [Mon Jul 25 19:07:27 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:27.877659 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:27.915197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:28.000515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74b0f0-d575-414f-811e-29af8cf35314 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:28.045736 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:28.046412 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:28.046707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:28.046970 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:28.047716 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:28.048100 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:28.049410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:28.055751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 383/782] 10.222.0.112 () {56 vars in 1131 bytes} [Mon Jul 25 19:07:27 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:28.062050 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:28.083349 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:28.171312 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6164f-05cc-4aaa-b8e2-5ad25b8ed786 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:28.215418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:28.216072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:28.216358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:28.216636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:28.217457 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] RBAC: Adding query filter params (interface=public, service_id=e83d1e679b7a4872a47b067789b9d28d, region_id=RegionOne) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:28.217768 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:28.219161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd9ba81-38e6-4342-8ea0-3e4447005d53 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:28.225651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 400/783] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:07:28 2022] GET /identity/v3/endpoints?service_id=e83d1e679b7a4872a47b067789b9d28d&interface=public®ion_id=RegionOne => generated 195 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:28.232265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:28.340485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:28.348686 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87303b9c-3f8c-4aef-9a4c-96b1c36fb25a None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:28.389858 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa39c4-efa4-46a4-adfb-4bbd76bbeeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:28.390530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa39c4-efa4-46a4-adfb-4bbd76bbeeb3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:28.390815 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa39c4-efa4-46a4-adfb-4bbd76bbeeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:28.391127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa39c4-efa4-46a4-adfb-4bbd76bbeeb3 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:28.391808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa39c4-efa4-46a4-adfb-4bbd76bbeeb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:28.393209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaa39c4-efa4-46a4-adfb-4bbd76bbeeb3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:28.399778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 384/784] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:07:28 2022] GET /identity/v3/services => generated 1505 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:07:29.727789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa7cb0-b94a-4306-8f2e-8554a6f9e829 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:29.728611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa7cb0-b94a-4306-8f2e-8554a6f9e829 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:29.728759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa7cb0-b94a-4306-8f2e-8554a6f9e829 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:29.730436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 401/785] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:29 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:29.739906 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:29.740684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:29.740684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:29.765826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:29.768039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:29.881416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 385/786] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:29 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:29.912903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa7cb0-b94a-4306-8f2e-8554a6f9e829 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.023037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.055256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa7cb0-b94a-4306-8f2e-8554a6f9e829 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.117506 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.118330 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.118617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.118938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.119916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:30.121649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:30.124424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING keystone.server.flask.common [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 19:07:30.148340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.sql.core [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 19:07:30.148340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 19:07:30.148340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [parameters: {'id': '14f36d3267ac4af7a740d928308d9e43', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 19:07:30.148340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87475) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 14f36d3267ac4af7a740d928308d9e43.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 14f36d3267ac4af7a740d928308d9e43. Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:07:30.166128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application result.read() Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 25 19:07:30.167218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application yield resource Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise self.value Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application session.commit() Jul 25 19:07:30.168272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self.session.flush() Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application compat.raise_( Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 19:07:30.169431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 19:07:30.171788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application result.read() Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:07:30.173580 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [parameters: {'id': '14f36d3267ac4af7a740d928308d9e43', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:30.175767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:30.177614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 14f36d3267ac4af7a740d928308d9e43. Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:30.179316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 402/787] 10.222.0.112 () {60 vars in 1145 bytes} [Mon Jul 25 19:07:29 2022] POST /identity/v3/projects => generated 262 bytes in 256 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:30.180902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.291772 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.310400 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b3e4be-d1d9-4a53-9194-43f46c02d5ec None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.355135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.356269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.357254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.357254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.369027 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:30.370659 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-96a34e1f-ac1c-472c-bbf2-510884bfb361 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:07:30.385813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:30.387636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:30.389210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 386/788] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:30.394429 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:30.531633 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdac9a8-6706-4935-9bce-27e0498f4317 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:30.575256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:30.576011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:30.576366 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:30.576709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:30.577631 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:30.577995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:30.579758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671d982-b981-4bd8-b238-0fcaf71e28c4 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:30.591218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:30.604067 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 403/789] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:30 2022] GET /identity/v3/projects?name=service => generated 413 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:31.120148 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81d5e4-cf39-4e36-ae85-5e3902578fc7 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.120965 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81d5e4-cf39-4e36-ae85-5e3902578fc7 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.121119 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec81d5e4-cf39-4e36-ae85-5e3902578fc7 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.122644 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 387/790] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:31 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:31.129036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.129618 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.129618 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.150415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:31.153195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:31.256758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 404/791] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:31 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:31.283621 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81d5e4-cf39-4e36-ae85-5e3902578fc7 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:31.431076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec81d5e4-cf39-4e36-ae85-5e3902578fc7 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:31.468987 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:31.469948 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.470326 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.470695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.471515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:31.473065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:31.486497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:31.487727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:31.488725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 388/792] 10.222.0.112 () {56 vars in 1137 bytes} [Mon Jul 25 19:07:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:31.497042 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:31.656477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fbe570-ed49-48c1-a08c-c14aaad8d60e None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:31.691612 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:31.704470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:31.705513 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.705778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.706079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.706780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:31.707087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:31.708524 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:31.714034 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 405/793] 10.222.0.112 () {56 vars in 1131 bytes} [Mon Jul 25 19:07:31 2022] GET /identity/v3/services?name=compute_legacy => generated 132 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:31.720206 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:31.736432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:31.858022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696ee5a9-3ea8-41ec-a998-d785cf59aaec None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:31.920877 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:31.921558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:31.921846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:31.922144 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:31.922844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:31.923154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:31.924599 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f64d7b-a493-4db0-a4f9-b534caf62819 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:31.930419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 389/794] 10.222.0.112 () {56 vars in 1131 bytes} [Mon Jul 25 19:07:31 2022] GET /identity/v3/services?type=compute_legacy => generated 388 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:31.937401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:32.059872 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79443857-3e89-44b3-bb86-c4d969b41356 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:32.095999 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427633c4-e79d-43af-baf6-1a62b085d68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:32.096687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427633c4-e79d-43af-baf6-1a62b085d68b None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:32.096933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427633c4-e79d-43af-baf6-1a62b085d68b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:32.097210 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427633c4-e79d-43af-baf6-1a62b085d68b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:32.097948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427633c4-e79d-43af-baf6-1a62b085d68b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:32.099669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427633c4-e79d-43af-baf6-1a62b085d68b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:32.126391 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 406/795] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:07:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:07:33.149389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c87e47-929e-4879-a05a-1a54eca1de5f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.149906 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c87e47-929e-4879-a05a-1a54eca1de5f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.150244 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c87e47-929e-4879-a05a-1a54eca1de5f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.152608 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 390/796] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:33 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:33.159346 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.159984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.159984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.183159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:33.184988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:33.238488 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:33.272319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 407/797] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:33 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:33.298363 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c87e47-929e-4879-a05a-1a54eca1de5f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:33.412274 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:33.454534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c87e47-929e-4879-a05a-1a54eca1de5f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:33.497909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:33.498587 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.498864 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.499144 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.499885 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:33.501371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:33.504000 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING keystone.server.flask.common [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 25 19:07:33.517717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.sql.core [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 19:07:33.517717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 19:07:33.517717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [parameters: {'user_id': 'bd101878f2c044909ddbb018dabc4ca3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 19:07:33.517717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87474) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application result.read() Jul 25 19:07:33.535797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:07:33.536889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application yield resource Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application next(self.gen) Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self.session.rollback() Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self.force_reraise() Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise self.value Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application session.commit() Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 25 19:07:33.538260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._prepare_impl() Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self.session.flush() Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._flush(objects) Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application compat.raise_( Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application flush_context.execute() Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rec.execute(self) Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 25 19:07:33.539552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 25 19:07:33.540751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application result = self._query(query) Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application conn.query(q) Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application result.read() Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 25 19:07:33.541727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [parameters: {'user_id': 'bd101878f2c044909ddbb018dabc4ca3', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:33.542908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 25 19:07:33.543876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:33.544795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 391/798] 10.222.0.112 () {60 vars in 1136 bytes} [Mon Jul 25 19:07:33 2022] POST /identity/v3/users => generated 160 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:33.547476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:33.724807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297f768-597c-4bc4-ad28-027bf42122a5 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:33.785084 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:33.786319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:33.786797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:33.787246 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:33.798974 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:33.801734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-3ac67696-4305-4531-bbfe-8cf04b62fed4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:07:33.826080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:33.827774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:33.829660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 408/799] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:07:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:33.841415 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:33.994454 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73725c4f-f8c8-4d86-bd7a-f5f018bd408f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:34.045382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:34.046063 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.046352 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.046626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.047478 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:34.047787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:34.049492 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63deef5-adf3-4385-a165-caf364669053 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:34.068921 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:34.095119 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 392/800] 10.222.0.112 () {56 vars in 1106 bytes} [Mon Jul 25 19:07:33 2022] GET /identity/v3/users?name=cinder => generated 356 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:34.770671 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b446-e6f1-48e6-a832-78f6831d671c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.771344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b446-e6f1-48e6-a832-78f6831d671c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.771344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95b446-e6f1-48e6-a832-78f6831d671c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.772855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 409/801] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:34 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:34.779794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:34.780323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:34.780672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:34.822172 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:34.824297 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:34.920828 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 393/802] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:34 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:34.953236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b446-e6f1-48e6-a832-78f6831d671c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:34.999092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:35.098561 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95b446-e6f1-48e6-a832-78f6831d671c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:35.158377 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:35.159634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:35.160045 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:35.160446 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:35.161487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:35.163699 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:35.184169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:35.186401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:35.188308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 410/803] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:35.196555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:35.351488 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95972e8-f054-486f-9f47-f5b332f44671 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:35.384914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:35.394888 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:35.395656 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:35.395947 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:35.396224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:35.396957 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] RBAC: Adding query filter params (name=compute) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:35.397329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:35.398877 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ea75-9afc-41e6-b47b-01b9bc7a0a6a None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:35.404634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 394/804] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:35 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:35.413697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:35.571811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:35.576200 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf344353-29ff-4a63-9caf-67843ebdbe1d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:35.617715 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:35.618327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:35.618662 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:35.618987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:35.619798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:35.620189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:35.621704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a949dcf4-fe7f-44bc-b684-19f97dbcbbc5 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:35.631804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 411/805] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:35 2022] GET /identity/v3/services?type=compute => generated 125 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:37.897378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07627-0a5a-458d-8b92-39a7d50deb53 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.897942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07627-0a5a-458d-8b92-39a7d50deb53 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.898316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d07627-0a5a-458d-8b92-39a7d50deb53 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.900362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 395/806] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:37 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:37.908591 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8536-37d1-4d9d-8679-c6edf0fe1a2c None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:37.909383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8536-37d1-4d9d-8679-c6edf0fe1a2c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:37.909532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb8536-37d1-4d9d-8679-c6edf0fe1a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:37.947263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-48bb8536-37d1-4d9d-8679-c6edf0fe1a2c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:37.949176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-48bb8536-37d1-4d9d-8679-c6edf0fe1a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:38.037995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 412/807] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:37 2022] POST /identity/v3/auth/tokens => generated 1610 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:38.062454 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d07627-0a5a-458d-8b92-39a7d50deb53 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:38.181389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d07627-0a5a-458d-8b92-39a7d50deb53 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:38.230575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b727035-1a22-4135-8ff6-aefcff1eef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:38.231235 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727035-1a22-4135-8ff6-aefcff1eef28 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:38.231558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727035-1a22-4135-8ff6-aefcff1eef28 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:38.231833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b727035-1a22-4135-8ff6-aefcff1eef28 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:38.232559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727035-1a22-4135-8ff6-aefcff1eef28 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:38.234065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b727035-1a22-4135-8ff6-aefcff1eef28 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:38.251154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 396/808] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:07:38 2022] POST /identity/v3/services => generated 243 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:40.553437 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd122-6c04-4202-9bad-3d42b30ddf35 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:40.554164 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd122-6c04-4202-9bad-3d42b30ddf35 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:40.554281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fd122-6c04-4202-9bad-3d42b30ddf35 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:40.556411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 413/809] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:40 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:40.564836 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:40.565405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:40.565760 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:40.587529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:40.588747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:40.644600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:40.679229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 397/810] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:40 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:40.704360 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd122-6c04-4202-9bad-3d42b30ddf35 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:40.823259 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:40.841721 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fd122-6c04-4202-9bad-3d42b30ddf35 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:40.888311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:40.889120 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:40.889401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:40.889676 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] PATH_INFO: `/v3/services/compute` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:40.890338 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:40.891823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:40.904797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:40.906310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:07:40.907493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 414/811] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:40.912939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:41.036086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0fc93-cbac-4ff9-8c30-8d8873c2320e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:41.074781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:41.075370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:41.075690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:41.075967 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:41.076689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] RBAC: Adding query filter params (name=compute) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:41.076994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:41.078408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:41.085607 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 398/812] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:40 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:41.090415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:41.213373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090e923-d342-4b29-a9cc-f2f0b257c4cf None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:41.254885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:41.255634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:41.255923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:41.256199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:41.256919 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] RBAC: Adding query filter params (type=compute) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:41.257228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:41.258626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:41.264084 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 415/813] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:41 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:07:41.271981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:41.335726 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:41.430735 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff656944-9617-4174-9e2c-9cfc0cadc27d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:41.480532 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:41.481293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:41.481454 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:41.481722 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:41.482511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] RBAC: Adding query filter params (interface=public, service_id=e91ae88855994ff7871a4ce19f300f95, region_id=RegionOne) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:41.482825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:41.484250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eec384-6f45-4820-987e-4b17c010a547 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:41.492032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 399/814] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:07:41 2022] GET /identity/v3/endpoints?service_id=e91ae88855994ff7871a4ce19f300f95&interface=public®ion_id=RegionOne => generated 195 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:41.498355 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:41.533577 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:41.635250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8eea73-8bf4-48c5-ac85-b1d90788deab None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:41.682772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07b6605-e687-4043-b9f5-ab2bf07729f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:41.683551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6605-e687-4043-b9f5-ab2bf07729f5 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:41.683977 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6605-e687-4043-b9f5-ab2bf07729f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:41.684452 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07b6605-e687-4043-b9f5-ab2bf07729f5 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:41.685602 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b6605-e687-4043-b9f5-ab2bf07729f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:41.688029 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07b6605-e687-4043-b9f5-ab2bf07729f5 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:41.702104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 416/815] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:07:41 2022] GET /identity/v3/services => generated 1736 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:07:44.068495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8cf3-07d7-492a-abaf-8d98b0bab86d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:44.069044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8cf3-07d7-492a-abaf-8d98b0bab86d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:44.069044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebd8cf3-07d7-492a-abaf-8d98b0bab86d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:44.070472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 400/816] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:07:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:07:44.076448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:44.077013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:44.077013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:44.098953 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:07:44.100180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:07:44.182436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 417/817] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:07:44 2022] POST /identity/v3/auth/tokens => generated 1706 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:07:44.207753 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8cf3-07d7-492a-abaf-8d98b0bab86d None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:44.323189 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebd8cf3-07d7-492a-abaf-8d98b0bab86d None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:44.325630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:44.360725 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:44.361435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:44.361716 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:44.361989 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:44.362642 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:44.364095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:07:44.376114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:07:44.377291 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:07:44.378245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 401/818] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:07:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:07:44.383756 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:44.399798 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:44.490922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9c875-0cfd-40ca-b1e3-0155b2a336d7 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:44.530181 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:44.530848 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:44.531136 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:44.531436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:44.532159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:44.532467 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:44.533942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:44.544825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 418/819] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:44 2022] GET /identity/v3/services?name=compute => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:44.551039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:44.662486 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d8cd8-3527-4e10-b7f5-cf734a39c5ab None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:44.702827 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:44.703557 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:44.703845 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:44.704233 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:44.704945 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:07:44.705257 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:44.706641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04f9936-e88e-434b-af32-b55c46f4b066 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:44.712226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 402/820] 10.222.0.112 () {56 vars in 1117 bytes} [Mon Jul 25 19:07:44 2022] GET /identity/v3/services?type=compute => generated 354 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:07:44.718612 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:07:44.815423 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:44.844700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28b72d1-020e-4378-85e1-bd3d304bf7a8 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:07:44.882874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905211e8-5882-43d1-8116-3239969c22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:07:44.883569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905211e8-5882-43d1-8116-3239969c22ed None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:07:44.883871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905211e8-5882-43d1-8116-3239969c22ed None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:07:44.884212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905211e8-5882-43d1-8116-3239969c22ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:07:44.884905 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905211e8-5882-43d1-8116-3239969c22ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:07:44.886287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905211e8-5882-43d1-8116-3239969c22ed None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:07:44.908326 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 419/821] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:07:44 2022] POST /identity/v3/endpoints => generated 336 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:07:54.709337 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=84 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:07:54.903424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:49.870031 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcf13-2723-4924-9711-a7dc4714be32 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:49.870949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcf13-2723-4924-9711-a7dc4714be32 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:49.870949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bcf13-2723-4924-9711-a7dc4714be32 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:49.872013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 403/822] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:08:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:49.877547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:49.878077 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:49.878167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:49.899233 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:49.900486 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:49.994162 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 420/823] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:49 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:50.021790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bcf13-2723-4924-9711-a7dc4714be32 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.177656 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bcf13-2723-4924-9711-a7dc4714be32 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.226926 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.227975 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.228402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.229387 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.247471 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.249508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:50.276519 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:50.277647 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:50.278657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:50.278657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:50.278657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:50.278657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:08:50.278657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 404/824] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:08:50.285674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.412025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2243d8e8-3f22-4ad6-83df-1d6d0df7af22 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.445317 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.455208 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.456035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.456336 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.456601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.457575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:50.457936 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.459332 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62af6fd0-b556-42ab-82cf-c4c9c90e5eeb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.472751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 421/825] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:50 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:08:50.479564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:50.553188 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:50.617238 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd524f4-76d3-41bb-bd57-d52eddcc79c5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:50.658724 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba046ae3-f6df-43cd-be9f-f8863b6afd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:50.659568 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046ae3-f6df-43cd-be9f-f8863b6afd73 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:50.659834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046ae3-f6df-43cd-be9f-f8863b6afd73 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:50.660147 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba046ae3-f6df-43cd-be9f-f8863b6afd73 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:50.660936 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba046ae3-f6df-43cd-be9f-f8863b6afd73 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:50.662393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba046ae3-f6df-43cd-be9f-f8863b6afd73 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:50.697258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 405/826] 10.222.0.112 () {60 vars in 1137 bytes} [Mon Jul 25 19:08:50 2022] POST /identity/v3/users => generated 252 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:08:53.058696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229fb0d-e72f-460f-b71d-4c3b75ee391f None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.059310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229fb0d-e72f-460f-b71d-4c3b75ee391f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.059930 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4229fb0d-e72f-460f-b71d-4c3b75ee391f None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.063141 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 422/827] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:08:53 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:53.068973 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.069505 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.069724 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.091015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:53.092429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:53.178102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 406/828] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:53 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:08:53.205140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229fb0d-e72f-460f-b71d-4c3b75ee391f None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:53.332373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4229fb0d-e72f-460f-b71d-4c3b75ee391f None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:53.381516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:53.382511 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.382841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.383485 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.398664 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:53.407157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:53.408789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:53.410011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 423/829] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:53.415723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:53.461908 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:53.539648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cbefdc-bbf2-477e-9437-ab43fcc64eaa None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:53.588061 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:53.588927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.589386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.589737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.590626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] RBAC: Adding query filter params (name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:53.590939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:53.592396 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:53.603107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 407/830] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:08:53.610184 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:53.677195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:53.754958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30028883-e040-4711-8f0b-857e339115e0 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:53.802788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:53.803657 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:53.803941 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:53.804214 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:53.818381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:53.820531 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:53.844979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:53.846033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:53.846944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:53.846944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:53.846944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:53.846944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:53.846944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 424/831] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:53.854730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.000304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:54.004750 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beaf178-b24d-4329-a12e-78168fdc0da5 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.062589 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.063413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.063786 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.064245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.065540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:54.065935 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.068065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.086550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 408/832] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:53 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:54.093915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.216887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:54.221549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b01f487-c69a-46f4-a845-2bee829bf020 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.260413 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.261147 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.261418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.261720 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] PATH_INFO: `/v3/users/placement` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.270523 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.272189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:54.290374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:54.291822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:54.292858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 425/833] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:54.298245 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.424353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dad027-1e9e-45fb-9d62-e102c262be1c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.463898 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.464568 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.464848 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.465152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.465953 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:54.466255 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.467749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.485979 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 409/834] 10.222.0.112 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:54.492350 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.612112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b163b1c-94a2-4eaf-91df-71825ff5a2ef None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:54.654750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:54.655545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:54.655908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:54.656119 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:54.690499 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:54.751269 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:54.754880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:54.891427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 426/835] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 25 19:08:54.897269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:54.922569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.013644 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1157f7-2d0b-4412-a9d2-20ead087494d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.049099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.049874 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.050156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.050479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.061953 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.063505 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:55.083386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:55.084883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:55.086421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:55.086421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:55.086421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:55.086421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:08:55.086421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 410/836] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:55.091218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.168988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.219108 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425d90a2-44f8-4dfc-8613-d98ff0c3e34b None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.266237 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.267527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.267832 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.268123 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.269016 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:55.269459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.271516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.286054 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 427/837] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:55.292547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.376175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.411641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e05cda-cde9-4dfd-85be-c19acee1e469 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.454697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.455812 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.456316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.456865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.472299 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.474444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:08:55.490606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:55.491862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:08:55.492988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:08:55.494548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 411/838] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:55.501812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.617703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252187be-5c8b-412f-bbda-1468d1dcef5f None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.641576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.662886 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.663611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.663923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.664224 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.665074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:55.665468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.667130 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9658cfcf-0e06-4328-aa1b-923e3983bb3c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.684942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 428/839] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:08:55.691441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:55.819729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b54cb-ed26-433e-916f-a2ee2bc4c23e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:55.873265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:55.885258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:55.886380 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:55.886875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:55.887349 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:55.889258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=50fdd25fd4ca4e6ca5f31046c4dde96c) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:55.889846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:55.893370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca96f29-7789-4c13-839b-ce06bf4315c3 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:55.905534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 412/840] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:08:55 2022] GET /identity/v3/role_assignments?user.id=50fdd25fd4ca4e6ca5f31046c4dde96c&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:58.159475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26533-fff1-49bb-a22f-8f8dcf5ae61b None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.160065 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26533-fff1-49bb-a22f-8f8dcf5ae61b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.160065 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c26533-fff1-49bb-a22f-8f8dcf5ae61b None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.161366 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 429/841] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:08:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:08:58.166956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.167462 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.167572 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.199252 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:08:58.201041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:08:58.286093 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 413/842] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:08:58 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:08:58.313976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26533-fff1-49bb-a22f-8f8dcf5ae61b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.447617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c26533-fff1-49bb-a22f-8f8dcf5ae61b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.487708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.488623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.488939 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.489266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.506784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:08:58.514730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:58.516041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:58.520706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 430/843] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:58.522793 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.629346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dadf92-688f-414f-8064-ae35435fdbb0 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.657243 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:58.675057 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.676120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.676410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.676696 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.677527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] RBAC: Adding query filter params (name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:58.677941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:58.679547 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:58.691914 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 414/844] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:58.698924 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:58.748800 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:58.829657 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d686f0-8928-4dc0-95a8-a22d55e100d7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:58.865896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:58.866813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:58.867127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:58.867458 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:58.881015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:58.883518 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:58.903712 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:58.904958 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:58.911364 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:58.911364 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:58.911364 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:58.911364 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:58.911364 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 431/845] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:58.912068 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.035496 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a40fd3-78c3-45f7-bcc2-4b85fababf7e None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.078045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.078869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.079180 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.079535 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.080430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:59.080726 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.082449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.099744 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 415/846] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:58 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:08:59.101151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.214611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.226457 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e562f3ce-cb94-4bb5-97e4-e6589bf3e7be None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.271074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.272257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.272760 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.273197 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.284820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.287596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:08:59.303146 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:59.304549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:59.305914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 432/847] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:08:59.311218 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.367861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.449483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb5b74-e8d0-4cb5-9add-bb277f6eb225 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.492098 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.493391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.494027 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.494511 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.496134 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:59.496627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.499261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.524869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 416/848] 10.222.0.112 () {56 vars in 1148 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:59.530690 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.645753 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ce3304-c0f2-4572-95ff-a068aeed5435 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.684574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.684574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.684574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.684574 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.696497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.697963 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:08:59.716297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:08:59.717621 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:08:59.718697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:08:59.718697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:08:59.718697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:08:59.718697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:08:59.718697 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 433/849] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:08:59.724139 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.852209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc55e3-3702-4460-a037-e6e2e21e8105 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:08:59.854927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:08:59.894185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:08:59.894858 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:08:59.895176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:08:59.895485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:08:59.896302 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:08:59.896564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:08:59.897940 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:08:59.910765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 417/850] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:08:59.916936 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:08:59.921926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:00.045020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db3b72-d5d0-49b3-acd7-8fdbea5f16d1 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:00.086450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:00.087649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.088063 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.088484 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.099001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:00.101415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:09:00.118335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:00.124788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:00.125786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 434/851] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:08:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:00.126293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:00.238412 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb639feb-918a-44a4-8c60-0506c5c92736 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:00.278353 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:00.279026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.279381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.279690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.280655 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:00.280968 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:00.282561 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b28b6-8f6b-453f-bd92-a3ef65184e8c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:00.297252 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 418/852] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:09:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:00.304626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:00.397918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:00.450471 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c92a998-0183-45c2-961a-824620c6a386 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:00.491890 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c2d7f-3860-4dbd-b172-cffe31465334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:00.492777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2d7f-3860-4dbd-b172-cffe31465334 None admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:00.493065 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2d7f-3860-4dbd-b172-cffe31465334 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:00.493339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c2d7f-3860-4dbd-b172-cffe31465334 None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/50fdd25fd4ca4e6ca5f31046c4dde96c/roles/bcef782da7a3440d9bf6dadde1600113` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:00.510184 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2d7f-3860-4dbd-b172-cffe31465334 None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=50fdd25fd4ca4e6ca5f31046c4dde96c, role_id=bcef782da7a3440d9bf6dadde1600113)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:00.511752 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c2d7f-3860-4dbd-b172-cffe31465334 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:00.528527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 435/853] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:09:00 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/50fdd25fd4ca4e6ca5f31046c4dde96c/roles/bcef782da7a3440d9bf6dadde1600113 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:09:02.850003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d21ca-190f-44fb-8013-f11cbd1b2145 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.850688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d21ca-190f-44fb-8013-f11cbd1b2145 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.850688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d21ca-190f-44fb-8013-f11cbd1b2145 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.851959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 419/854] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:02 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:09:02.858276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:02.858825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:02.858916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:02.881128 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:02.882700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:02.967220 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 436/855] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:02 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:02.997956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d21ca-190f-44fb-8013-f11cbd1b2145 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.028711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.122981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d21ca-190f-44fb-8013-f11cbd1b2145 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.166458 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.167268 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.167645 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.167930 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.180323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:09:03.188963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:03.190904 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:03.192670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 420/856] 10.222.0.112 () {56 vars in 1107 bytes} [Mon Jul 25 19:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:03.197081 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.260708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.326134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb20802-e5fc-4ab7-b2ec-a7c623247557 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.365089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.365897 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.366264 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.366545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.367399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:03.367728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.369241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.378915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 437/857] 10.222.0.112 () {56 vars in 1108 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/roles?name=service => generated 328 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:03.385878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.500659 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.520767 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe254371-9953-4a03-8efc-c28bc27f4a9b None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.559241 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.560089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.560435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.560853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.574596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.576220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:03.596564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:03.597771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:03.598922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:03.598922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:03.598922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:03.598922 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:03.604260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 421/858] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:03.604417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.729513 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0d22fd-4d77-41fd-b483-09efad9317e6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.732295 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.782970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.784445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.785132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.785132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.787041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:03.787041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.788417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.809126 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 438/859] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:03.817866 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:03.930859 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e7692c-57f7-443b-90a1-5fe5a3fd1d30 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:03.969526 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:03.970376 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:03.970666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:03.970966 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:03.974356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:03.980136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:03.981697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:09:03.996484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:04.003182 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:04.004538 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 422/860] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:04.006018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.131877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a7a406-1efe-4224-9b3e-d2a113ea4996 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.174229 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.174953 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.175231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.175535 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.176379 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:04.176683 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.178095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.197335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 439/861] 10.222.0.112 () {56 vars in 1148 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:04.204742 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.315268 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bbe03c-f742-4e7b-b5c2-603fa8d9ab53 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.353948 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.354732 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.354990 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.355265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.434552 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:04.446631 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.448483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.575000 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 423/862] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:09:04.581453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.613794 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:04.704661 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4a6f8-58c3-4586-b061-f70ad95a206d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.752498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.753881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.754431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.754903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.766762 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.768495 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:04.790986 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:04.792316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:04.793865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:04.793865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:04.793865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:04.793865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:04.793865 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 440/863] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 25 19:09:04.799944 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:04.902732 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:04.909985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0eab4-e645-4dbc-b058-bdfd68580dec None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:04.949626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:04.950316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:04.950636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:04.950919 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:04.951736 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:04.952053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:04.953491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:04.966228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 424/864] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:04.972339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:05.057084 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:05.085774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe567fb2-cb65-4fa9-bc89-a4b07d698ab2 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:05.124140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:05.124941 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:05.125298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:05.125633 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:05.132992 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:05.134424 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:09:05.148537 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:05.149530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:05.155874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 441/865] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:05.156402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:05.275853 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b223e6ff-8988-4ef8-9732-30f85af410a4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:05.311379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:05.312112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:05.312441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:05.312720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:05.313593 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:05.313932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:05.315679 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c501fc-58a7-44f6-8d1f-a3d4d3f19935 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:05.329368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 425/866] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:05.335849 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:05.453447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910ff43-6f58-48a0-87a3-0652a1ab6ab4 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:05.492562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:05.493103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:05.493381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:05.493662 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:05.494507 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] RBAC: Adding query filter params (role.id=bcef782da7a3440d9bf6dadde1600113, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=50fdd25fd4ca4e6ca5f31046c4dde96c) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:05.494822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:05.496296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcdbe3d-aafd-4139-be71-1f2837a1364c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:05.498258 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:05.503092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 442/867] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:09:05 2022] GET /identity/v3/role_assignments?user.id=50fdd25fd4ca4e6ca5f31046c4dde96c&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=bcef782da7a3440d9bf6dadde1600113 => generated 610 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:07.792470 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c498161-6e2e-469b-af39-4df75d016b85 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:07.793010 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c498161-6e2e-469b-af39-4df75d016b85 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:07.793124 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c498161-6e2e-469b-af39-4df75d016b85 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:07.794808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 426/868] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:07 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:09:07.800661 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:07.801137 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:07.801228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:07.822099 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:07.823311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:07.909774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 443/869] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:07 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:07.936306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c498161-6e2e-469b-af39-4df75d016b85 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:07.959041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:08.072876 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c498161-6e2e-469b-af39-4df75d016b85 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:08.116934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:08.117757 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:08.118175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:08.118365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:08.132531 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:09:08.144915 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:08.152959 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:08.153831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 427/870] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:09:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:08.154568 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:08.269426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8d072-51a1-4cc5-a439-f23f584d5e69 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:08.309465 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:08.318988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:08.319698 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:08.319981 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:08.320273 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:08.321006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:08.321314 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:08.322691 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:08.338946 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 444/871] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:09:08 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:08.341152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:08.452571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:08.482602 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111138f-7bd3-4d32-9714-83ac5c8fda11 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:08.525408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:08.526304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:08.526601 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:08.526917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:08.541648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:08.543613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:08.563920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:08.565171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:08.566455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:08.566455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:08.566455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:08.566455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:08.566455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 428/872] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:08.571786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:08.693345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f871a-54ab-4cd9-9c8a-0eb15db95b4a None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:08.733498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:08.734418 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:08.734779 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:08.735178 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:08.736053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:08.736736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:08.738245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:08.756678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 445/873] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:08 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:08.763580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:08.895323 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8968f-b187-4dc8-a00f-a2e51bc83809 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:08.932932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:08.945469 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:08.946604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:08.947174 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:08.947553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:08.958251 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:08.959783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:09:08.976258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:08.978913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:08.981558 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 429/874] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:08.983964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:09.053358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:09.116736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a141ee-84a1-4d51-8c89-394233b52ccd None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:09.158701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:09.159428 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.159709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.159991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.160851 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:09.161169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:09.162669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:09.184846 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 446/875] 10.222.0.112 () {56 vars in 1148 bytes} [Mon Jul 25 19:09:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:09.192249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:09.315309 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96fac6d-dfca-44c2-be5b-b56ee789f338 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:09.365983 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:09.366672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.366958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.367241 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.446916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:09.465354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:09.466852 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:09.608894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 430/876] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:09:09 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:09:09.610644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:09.728280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2a668-5c77-476b-8269-623eeb683514 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:09.739065 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:09.769718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:09.770451 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.770734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.771005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.785584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:09.787020 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:09.806654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:09.807771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:09.814100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:09.814100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:09.814100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:09.814100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:09.814100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 447/877] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:09.815326 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:09.931012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:09.947029 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8742b-85b9-4c48-b41f-9934f7d6cf04 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:09.988794 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:09.989582 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:09.989860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:09.990233 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:09.990996 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:09.991384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:09.992958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:10.005830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 431/878] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:09 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:10.018104 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:10.128757 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0fc323-1f40-4d63-9c36-939a8fe4caec None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:10.168724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:10.169529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:10.169807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:10.170082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:10.177335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:10.178991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:09:10.193881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:10.195018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:10.196289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 448/879] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:10.201521 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:10.333818 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb715d3f-d9b0-4f5b-b1f8-27e277620a62 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:10.370395 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:10.371030 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:10.371307 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:10.371653 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:10.372450 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:10.372752 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:10.374199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc5821-865e-4b4d-bdf9-5cad3092f4e9 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:10.388389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 432/880] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:10.395342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:10.425941 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:10.523757 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405375a7-2522-46d4-bf71-40a267838de6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:10.565869 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:10.566669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:10.567069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:10.567348 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:10.568387 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=50fdd25fd4ca4e6ca5f31046c4dde96c) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:10.568703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:10.570280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac715eb5-f5de-4910-8316-e930b9078b5b None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:10.578324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 449/881] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:09:10 2022] GET /identity/v3/role_assignments?user.id=50fdd25fd4ca4e6ca5f31046c4dde96c&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:12.808418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d9b2-8cd2-4e2c-9dcc-a99a4d38ee55 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.809062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d9b2-8cd2-4e2c-9dcc-a99a4d38ee55 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.809062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d90d9b2-8cd2-4e2c-9dcc-a99a4d38ee55 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.810425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 433/882] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:12 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:12.815964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:12.816473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:12.816473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:12.835001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:12.836230 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:12.909716 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 450/883] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:12 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:12.934664 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90d9b2-8cd2-4e2c-9dcc-a99a4d38ee55 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:12.948489 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:13.044269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d90d9b2-8cd2-4e2c-9dcc-a99a4d38ee55 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:13.079307 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:13.080088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.080369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.080713 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.091410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:09:13.098962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:13.100176 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:13.101312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 434/884] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:09:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:13.108222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:13.123483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:13.222063 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a5c731-a304-4f83-a97b-77c0bcc794b5 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:13.261459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:13.262127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.262420 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.262701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.263460 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:13.263789 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:13.265159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:13.273447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 451/885] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:09:13 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:13.282545 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:13.363958 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:13.405250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7821d57e-2fa5-463c-ad23-b2365d51336f None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:13.448387 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:13.449379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.449726 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.450043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.464804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:13.466620 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:13.486459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:13.487687 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:13.488781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:13.488781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:13.488781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:13.488781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:13.488781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 435/886] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:13.494203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:13.582089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:13.613130 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca678fb-85bd-4e01-a83f-6ff0219ce059 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:13.654324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:13.654900 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.655178 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.655462 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.656200 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:13.656501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:13.657990 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:13.671633 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 452/887] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:13 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:13.679280 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:13.793512 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5718e1-6c22-4c3b-bbed-ef93832790fe None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:13.818984 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:13.840209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:13.841033 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:13.841318 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:13.841586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] PATH_INFO: `/v3/users/placement` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:13.850298 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:13.851804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:09:13.866461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:13.867709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:13.868706 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 436/888] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:13.873791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:13.984733 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead9fe2f-16b4-4b5f-b345-52dc77feb20c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.018331 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.018998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.019280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.019596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.020734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:14.021046 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:14.022466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:14.025032 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:14.049680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 453/889] 10.222.0.112 () {56 vars in 1148 bytes} [Mon Jul 25 19:09:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:14.055563 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:14.178535 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566612f2-2391-47eb-9965-c207a1b8b0dc None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.222145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.222924 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.223204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.223658 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.235508 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:14.236933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:14.255133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:14.256247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:14.257361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:14.257361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:14.257361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:14.257361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:14.257361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 437/890] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:14.262206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:14.374203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0f4ee-24e5-4bd2-a047-5247d2d0ccf7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.418759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.419547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.419826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.420140 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.420949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:14.421288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:14.422866 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:14.436807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 454/891] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:14 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:14.443022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:14.481362 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:14.565693 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f64da2-124c-4702-bf71-d0de1dbc7fc4 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.604995 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.605883 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.606266 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.606595 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.614673 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:14.616634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:09:14.631041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:14.632370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:14.633292 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 438/892] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:09:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:14.638879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:14.701518 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:14.754595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a96490-ed6b-446b-8283-8470d0df3848 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.797714 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.798440 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.798724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.799001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:14.799895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:14.800199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:14.801632 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e9d141-0e35-4016-bc50-db8c34f2f630 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:14.816849 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 455/893] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:14.823976 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:14.942316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:14.953743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407e657-de17-4eb6-9dc4-76500766d858 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:14.995231 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5089ce6-6a7e-4cc3-97f3-6fdfda3a8c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:14.996695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089ce6-6a7e-4cc3-97f3-6fdfda3a8c0e None admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:14.997161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089ce6-6a7e-4cc3-97f3-6fdfda3a8c0e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:14.997621 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5089ce6-6a7e-4cc3-97f3-6fdfda3a8c0e None admin] PATH_INFO: `/v3/projects/9ba0954eaec24e5693174204533745a9/users/50fdd25fd4ca4e6ca5f31046c4dde96c/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:15.001234 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5089ce6-6a7e-4cc3-97f3-6fdfda3a8c0e None admin] RBAC: Authorizing `identity:create_grant(project_id=9ba0954eaec24e5693174204533745a9, user_id=50fdd25fd4ca4e6ca5f31046c4dde96c, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:15.003703 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5089ce6-6a7e-4cc3-97f3-6fdfda3a8c0e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:15.025066 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 439/894] 10.222.0.112 () {58 vars in 1444 bytes} [Mon Jul 25 19:09:14 2022] PUT /identity/v3/projects/9ba0954eaec24e5693174204533745a9/users/50fdd25fd4ca4e6ca5f31046c4dde96c/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:09:17.239859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ccd9f-3611-47a0-9680-1e4a9e4256cd None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:17.240389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ccd9f-3611-47a0-9680-1e4a9e4256cd None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:17.240389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ccd9f-3611-47a0-9680-1e4a9e4256cd None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:17.241702 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 456/895] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:17 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:17.247778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:17.248210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:17.248320 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:17.271047 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:17.272301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:17.343411 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 440/896] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:17.370679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ccd9f-3611-47a0-9680-1e4a9e4256cd None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:17.501766 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ccd9f-3611-47a0-9680-1e4a9e4256cd None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:17.515975 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:17.541706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:17.542505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:17.542787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:17.543064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:17.554204 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 25 19:09:17.562157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:17.563579 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:17.564914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 457/897] 10.222.0.112 () {56 vars in 1101 bytes} [Mon Jul 25 19:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:17.572855 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:17.672734 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:17.697596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd5e7d-09b4-4020-a9d9-15910db53c96 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:17.732798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:17.733468 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:17.733755 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:17.734027 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:17.734773 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:17.735076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:17.736530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:17.746076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 441/898] 10.222.0.112 () {56 vars in 1104 bytes} [Mon Jul 25 19:09:17 2022] GET /identity/v3/roles?name=admin => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:17.752660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:17.867450 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d0afa-d61f-42ff-82da-481c86d5d302 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:17.907018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:17.907895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:17.908164 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:17.908435 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:17.919492 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:17.920910 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:17.939487 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:17.940532 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:17.941540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:17.941540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:17.941540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:17.941540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:17.941540 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 458/899] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:17.947548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:18.073249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163931ba-7709-42ae-9d0b-ac548618f13d None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:18.107622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:18.108301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:18.108583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:18.108860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:18.109583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:18.109894 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:18.111339 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:18.124627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 442/900] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:17 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:18.130690 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:18.161718 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:18.237635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b73853c-12be-44a0-8c6d-d0e0dc14bf87 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:18.273292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:18.274089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:18.274396 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:18.274655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:18.282402 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:18.283917 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 25 19:09:18.298771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:18.299896 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:18.301096 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 459/901] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:18.306524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:18.310625 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:18.437058 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475ff3d-4da2-4871-90d9-50004aaa8149 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:18.487173 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:18.487886 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:18.488171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:18.488450 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:18.489357 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:18.489666 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:18.491133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:18.509704 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 443/902] 10.222.0.112 () {56 vars in 1148 bytes} [Mon Jul 25 19:09:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 380 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:18.518985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:18.619670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:18.634882 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d92a37-bf32-4ad9-a15f-3c379f6bd8f6 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:18.677132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:18.677783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:18.678070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:18.678351 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:18.754602 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:18.757012 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:18.865837 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:18.883457 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 460/903] 10.222.0.112 () {58 vars in 1287 bytes} [Mon Jul 25 19:09:18 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 25 19:09:18.890128 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:18.979555 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:19.021175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917e9a55-bcac-4f6b-b593-81089130a49c None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:19.058578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:19.059375 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:19.059697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:19.059976 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:19.070748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:19.072261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 25 19:09:19.090495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:19.091676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:19.092609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 25 19:09:19.092609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 25 19:09:19.092609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 25 19:09:19.092609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:19.092609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 444/904] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:09:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:19.098456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:19.221543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41102cfb-c964-4e79-b193-afee745d4a9d None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:19.257426 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:19.258099 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:19.258383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:19.258686 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:19.259456 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:19.259780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:19.261159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:19.274605 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 461/905] 10.222.0.112 () {56 vars in 1114 bytes} [Mon Jul 25 19:09:19 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:19.281210 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:19.399582 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b873c4-df3b-4d98-8a7d-cc2afd18d05b None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:19.416678 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:19.456281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:19.457086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:19.457364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:19.457637 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:19.464846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:19.466301 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 25 19:09:19.480157 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:19.481281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: ERROR keystone.server.flask.application Jul 25 19:09:19.482632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 445/906] 10.222.0.112 () {56 vars in 1116 bytes} [Mon Jul 25 19:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:19.487830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:19.546296 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:19.616810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7703d9b-7b8a-403e-b480-9d8008a9e71c None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:19.655447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:19.656155 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:19.656434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:19.656719 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:19.657559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:19.657923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:19.659352 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11c0c72-5507-4990-adda-051c73442c8d None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:19.671562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 462/907] 10.222.0.112 () {56 vars in 1153 bytes} [Mon Jul 25 19:09:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 431 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:09:19.681881 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:19.813721 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa966e-944e-4fae-8c04-86522253c489 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:19.850884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:19.851579 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:19.851857 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:19.852131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:19.852954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] RBAC: Adding query filter params (role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7, scope.project.id=9ba0954eaec24e5693174204533745a9, user.id=50fdd25fd4ca4e6ca5f31046c4dde96c) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:19.853262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:19.854718 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c218f3f-f8de-497f-a85c-30265ba476f4 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:19.861356 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 446/908] 10.222.0.112 () {56 vars in 1379 bytes} [Mon Jul 25 19:09:19 2022] GET /identity/v3/role_assignments?user.id=50fdd25fd4ca4e6ca5f31046c4dde96c&scope.project.id=9ba0954eaec24e5693174204533745a9&role.id=39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 610 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:22.106203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb930a-3907-4308-bf14-faa365273615 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:22.106736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb930a-3907-4308-bf14-faa365273615 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:22.106736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acb930a-3907-4308-bf14-faa365273615 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:22.108092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 463/909] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:22 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:22.113809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:22.114358 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:22.114358 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:22.134317 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:22.135559 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:22.166616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:22.212429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 447/910] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:22 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 25 19:09:22.237082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb930a-3907-4308-bf14-faa365273615 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:22.357812 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acb930a-3907-4308-bf14-faa365273615 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:22.365666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:22.400035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:22.400910 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:22.401192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:22.401470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:22.402133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:22.403567 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:22.417529 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:22.419107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:22.420248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 464/911] 10.222.0.112 () {56 vars in 1122 bytes} [Mon Jul 25 19:09:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:22.425509 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:22.540220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7817ceea-e304-41b7-a5f7-8ae2f259f80e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:22.576811 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:22.577506 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:22.577788 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:22.578064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:22.578814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:22.579115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:22.580582 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112232f-31ce-4697-9319-868a4fc809cc None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:22.591140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 448/912] 10.222.0.112 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:22 2022] GET /identity/v3/services?name=placement => generated 127 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:22.597245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:22.730545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9675e2-cb73-41e5-85ff-ad98b07754c7 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:22.766324 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:22.767002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:22.767291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:22.767601 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] PATH_INFO: `/v3/services` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:22.768327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:22.768634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:22.770010 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e921bf-d798-4145-b71a-7e5164ecd770 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:22.775081 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 465/913] 10.222.0.112 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:22 2022] GET /identity/v3/services?type=placement => generated 127 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:25.096529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828f0e-f7a1-4b98-a780-3d392f8c8574 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:25.097256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828f0e-f7a1-4b98-a780-3d392f8c8574 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:25.097256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a828f0e-f7a1-4b98-a780-3d392f8c8574 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:25.098360 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 449/914] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:09:25.104662 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27b79-2dde-4237-b8ec-5b13f9005b24 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:25.105284 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27b79-2dde-4237-b8ec-5b13f9005b24 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:25.105406 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c27b79-2dde-4237-b8ec-5b13f9005b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:25.125280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-25c27b79-2dde-4237-b8ec-5b13f9005b24 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:25.126602 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-25c27b79-2dde-4237-b8ec-5b13f9005b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:25.160339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:25.207108 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 466/915] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:25 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:25.231495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a828f0e-f7a1-4b98-a780-3d392f8c8574 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:25.266254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:25.350737 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a828f0e-f7a1-4b98-a780-3d392f8c8574 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:25.392700 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c334f4cf-e2d1-4cb5-ad46-e291bda7caa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:25.393413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f4cf-e2d1-4cb5-ad46-e291bda7caa9 None admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:25.393695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f4cf-e2d1-4cb5-ad46-e291bda7caa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:25.393981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c334f4cf-e2d1-4cb5-ad46-e291bda7caa9 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:25.394731 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334f4cf-e2d1-4cb5-ad46-e291bda7caa9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:25.396215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c334f4cf-e2d1-4cb5-ad46-e291bda7caa9 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:25.425826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 450/916] 10.222.0.112 () {60 vars in 1146 bytes} [Mon Jul 25 19:09:25 2022] POST /identity/v3/services => generated 247 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:09:27.688086 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06c5d-9270-42a7-b18c-c2517eb48584 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:27.688947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06c5d-9270-42a7-b18c-c2517eb48584 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:27.688947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e06c5d-9270-42a7-b18c-c2517eb48584 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:27.691154 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 467/917] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:27 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:27.697593 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:27.698981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:27.699459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:27.720014 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:27.721215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:27.805164 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 451/918] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:27 2022] POST /identity/v3/auth/tokens => generated 1966 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:27.831804 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06c5d-9270-42a7-b18c-c2517eb48584 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:27.941800 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e06c5d-9270-42a7-b18c-c2517eb48584 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:27.980809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:27.981615 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:27.981902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:27.982180 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:27.982843 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:27.984352 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:27.996571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:27.997704 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:27.998584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 468/919] 10.222.0.112 () {56 vars in 1122 bytes} [Mon Jul 25 19:09:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:28.006434 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:28.035297 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:28.128437 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42125274-1b33-47c5-8880-a7dafce5c9a9 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:28.169833 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:28.170612 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:28.170895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:28.171194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:28.172140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:28.172469 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:28.175036 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:28.182097 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 452/920] 10.222.0.112 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:28 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:28.189922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:28.228245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:28.307868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60c45-61e7-4795-875c-eab2da73f0cb None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:28.343103 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:28.343791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:28.344078 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:28.344358 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:28.345150 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] RBAC: Adding query filter params (interface=public, service_id=7073799010ad4647b903c7dbf59a6cb8, region_id=RegionOne) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:28.345462 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:28.347115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d9476c-2959-4287-b9a4-c319fd445f81 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:28.353129 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 469/921] 10.222.0.112 () {56 vars in 1256 bytes} [Mon Jul 25 19:09:28 2022] GET /identity/v3/endpoints?service_id=7073799010ad4647b903c7dbf59a6cb8&interface=public®ion_id=RegionOne => generated 195 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:28.359712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:28.461385 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:28.484955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1dcf79-8135-4cf0-8370-fe987eaa9378 None admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:28.526370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ac592-d4b6-4e52-bc9c-e20811c639ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:28.527046 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac592-d4b6-4e52-bc9c-e20811c639ae None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:28.527331 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac592-d4b6-4e52-bc9c-e20811c639ae None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:28.527673 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ac592-d4b6-4e52-bc9c-e20811c639ae None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:28.528358 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac592-d4b6-4e52-bc9c-e20811c639ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:28.529752 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ac592-d4b6-4e52-bc9c-e20811c639ae None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:28.536568 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 453/922] 10.222.0.112 () {56 vars in 1092 bytes} [Mon Jul 25 19:09:28 2022] GET /identity/v3/services => generated 1971 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:09:30.768028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924bab3-7388-42b1-8836-5689d96c09c8 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:30.768938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924bab3-7388-42b1-8836-5689d96c09c8 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:30.768938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924bab3-7388-42b1-8836-5689d96c09c8 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:30.771364 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 470/923] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:09:30 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:09:30.778019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:30.778709 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:30.778892 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:30.800195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:09:30.801402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:09:30.876764 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 454/924] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:09:30 2022] POST /identity/v3/auth/tokens => generated 1966 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 25 19:09:30.901965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924bab3-7388-42b1-8836-5689d96c09c8 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:31.012880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:31.023818 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924bab3-7388-42b1-8836-5689d96c09c8 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:31.062110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:31.062909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:31.063189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:31.063491 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:31.064144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:31.065505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 25 19:09:31.077817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 25 19:09:31.079267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.get_or_create( Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application with Lock( Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self._enter() Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application return self.creator() Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application created_value = creator( Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: ERROR keystone.server.flask.application Jul 25 19:09:31.080361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 471/925] 10.222.0.112 () {56 vars in 1122 bytes} [Mon Jul 25 19:09:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 25 19:09:31.085557 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:31.176190 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:31.204710 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f096a-741d-4992-a13c-186a260c7c9e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:31.244164 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:31.244824 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:31.245104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:31.245378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] PATH_INFO: `/v3/services` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:31.246080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] RBAC: Adding query filter params (name=placement) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:09:31.246384 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:31.247804 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1b9396-e534-408e-b560-9156e116a35e None admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:31.253100 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 455/926] 10.222.0.112 () {56 vars in 1121 bytes} [Mon Jul 25 19:09:31 2022] GET /identity/v3/services?name=placement => generated 360 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:09:31.259385 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:09:31.374445 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbab1e52-b7d8-49c3-bb56-318bea229c46 None admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:09:31.407977 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074b59c-1cb9-4755-ba8b-803e2774a8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:09:31.408626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b59c-1cb9-4755-ba8b-803e2774a8f6 None admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:09:31.408911 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b59c-1cb9-4755-ba8b-803e2774a8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:09:31.409188 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074b59c-1cb9-4755-ba8b-803e2774a8f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:09:31.409926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074b59c-1cb9-4755-ba8b-803e2774a8f6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:09:31.411302 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074b59c-1cb9-4755-ba8b-803e2774a8f6 None admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:09:31.434786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 472/927] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:09:31 2022] POST /identity/v3/endpoints => generated 333 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:09:41.250178 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=30 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:09:41.429043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:33.264126 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028e87b-3c68-4e00-9ced-07639150ea85 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.264705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028e87b-3c68-4e00-9ced-07639150ea85 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.264705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f028e87b-3c68-4e00-9ced-07639150ea85 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.271626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2a6fc-95e8-4763-9d51-906d95962ddf None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.272157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2a6fc-95e8-4763-9d51-906d95962ddf None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.272157 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb2a6fc-95e8-4763-9d51-906d95962ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.277271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 456/928] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:33 2022] GET /identity => generated 271 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:33.296267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-6bb2a6fc-95e8-4763-9d51-906d95962ddf None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:33.297493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-6bb2a6fc-95e8-4763-9d51-906d95962ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:33.408172 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 473/929] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:33 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:10:33.464015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f9550-bd53-4f50-acd1-932a0fe8a5d4 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.464015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f9550-bd53-4f50-acd1-932a0fe8a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.464015 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f9550-bd53-4f50-acd1-932a0fe8a5d4 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.465062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 457/930] 10.222.0.112 () {54 vars in 970 bytes} [Mon Jul 25 19:10:33 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:33.471449 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18d21-93c8-4d16-8c44-b47790d2ea04 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.471758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18d21-93c8-4d16-8c44-b47790d2ea04 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.472186 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b18d21-93c8-4d16-8c44-b47790d2ea04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.567872 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-c9b18d21-93c8-4d16-8c44-b47790d2ea04 None None] MFA Rules not processed for user `6577ca8406124b4b9573937f8eea489d`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:33.569195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-c9b18d21-93c8-4d16-8c44-b47790d2ea04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:33.649498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 474/931] 10.222.0.112 () {58 vars in 1067 bytes} [Mon Jul 25 19:10:33 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:33.656181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f9550-bd53-4f50-acd1-932a0fe8a5d4 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:33.679841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f9550-bd53-4f50-acd1-932a0fe8a5d4 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:33.685869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b13acfb-4549-4739-a86c-95c3b057db59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:33.686402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13acfb-4549-4739-a86c-95c3b057db59 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:33.687032 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13acfb-4549-4739-a86c-95c3b057db59 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:33.687414 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b13acfb-4549-4739-a86c-95c3b057db59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:33.703312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13acfb-4549-4739-a86c-95c3b057db59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:33.705502 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b13acfb-4549-4739-a86c-95c3b057db59 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:33.720374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 458/932] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:33 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:36.270870 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bba70a-2782-4a2c-826f-e0bdccfe6e23 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:36.271422 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bba70a-2782-4a2c-826f-e0bdccfe6e23 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:36.271422 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bba70a-2782-4a2c-826f-e0bdccfe6e23 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:36.272746 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 475/933] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:36.278125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4273093-eb98-442d-8ba7-25762f0d285c None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:36.278575 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4273093-eb98-442d-8ba7-25762f0d285c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:36.278670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4273093-eb98-442d-8ba7-25762f0d285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:36.299913 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f4273093-eb98-442d-8ba7-25762f0d285c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:36.301131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f4273093-eb98-442d-8ba7-25762f0d285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:36.309727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 459/934] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:36 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:36.363534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4df4b-bbe2-4827-a675-62caa68dd2b7 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:36.363799 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4df4b-bbe2-4827-a675-62caa68dd2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:36.364100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4df4b-bbe2-4827-a675-62caa68dd2b7 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:36.365472 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 476/935] 10.222.0.112 () {54 vars in 970 bytes} [Mon Jul 25 19:10:36 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:36.372617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bf792-eee6-45dc-93d5-ff79039c0cf6 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:36.372617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bf792-eee6-45dc-93d5-ff79039c0cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:36.372617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bf792-eee6-45dc-93d5-ff79039c0cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:36.395628 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c09bf792-eee6-45dc-93d5-ff79039c0cf6 None None] MFA Rules not processed for user `6577ca8406124b4b9573937f8eea489d`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:36.396938 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c09bf792-eee6-45dc-93d5-ff79039c0cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:36.404711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 460/936] 10.222.0.112 () {58 vars in 1067 bytes} [Mon Jul 25 19:10:36 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:36.413755 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4df4b-bbe2-4827-a675-62caa68dd2b7 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:36.427432 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4df4b-bbe2-4827-a675-62caa68dd2b7 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:36.432022 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625621b6-0aaf-435d-a090-1205998e59c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:36.432678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625621b6-0aaf-435d-a090-1205998e59c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:36.432961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625621b6-0aaf-435d-a090-1205998e59c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:36.433236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625621b6-0aaf-435d-a090-1205998e59c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:36.443554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625621b6-0aaf-435d-a090-1205998e59c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:36.445110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625621b6-0aaf-435d-a090-1205998e59c4 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:36.454778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 477/937] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:36 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:39.222819 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc170f-fc09-4755-90a5-ae10d45c04ec None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:39.223373 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc170f-fc09-4755-90a5-ae10d45c04ec None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:39.223373 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fc170f-fc09-4755-90a5-ae10d45c04ec None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:39.224942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 461/938] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:39.230112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a2bb-10d4-46c9-917c-8855a0dc9378 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:39.230547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a2bb-10d4-46c9-917c-8855a0dc9378 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:39.230783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77a2bb-10d4-46c9-917c-8855a0dc9378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:39.270875 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-cb77a2bb-10d4-46c9-917c-8855a0dc9378 None None] MFA Rules not processed for user `a3979e4c2a5e4d198e1d5e640a715e94`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:39.272116 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-cb77a2bb-10d4-46c9-917c-8855a0dc9378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:39.315736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:10:39.348374 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 478/939] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:39 2022] POST /identity/v3/auth/tokens => generated 2801 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:39.389837 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc170f-fc09-4755-90a5-ae10d45c04ec None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:39.402185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fc170f-fc09-4755-90a5-ae10d45c04ec None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:39.406431 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232a8364-bce7-47e6-9845-2243b29e0ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:39.407185 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a8364-bce7-47e6-9845-2243b29e0ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:39.407576 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a8364-bce7-47e6-9845-2243b29e0ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:39.407918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232a8364-bce7-47e6-9845-2243b29e0ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:39.418154 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a8364-bce7-47e6-9845-2243b29e0ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:39.420441 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232a8364-bce7-47e6-9845-2243b29e0ab5 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:39.431740 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 462/940] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:39 2022] GET /identity/v3/auth/tokens => generated 2801 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:42.585130 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f326d8-0b13-402d-b6a9-fa42325dede5 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:42.585748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f326d8-0b13-402d-b6a9-fa42325dede5 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:42.585748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f326d8-0b13-402d-b6a9-fa42325dede5 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:42.587057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 479/941] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:42.592347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbd33-4e94-4b57-918a-b65358da8dbf None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:42.592795 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbd33-4e94-4b57-918a-b65358da8dbf None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:42.592890 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddbd33-4e94-4b57-918a-b65358da8dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:42.613101 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-8fddbd33-4e94-4b57-918a-b65358da8dbf None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:42.614311 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-8fddbd33-4e94-4b57-918a-b65358da8dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:42.688254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 463/942] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:42 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:42.727881 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f326d8-0b13-402d-b6a9-fa42325dede5 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:42.738959 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f326d8-0b13-402d-b6a9-fa42325dede5 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:42.742809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfc149-f793-40e1-98cb-52e294bd9195 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:42.743474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc149-f793-40e1-98cb-52e294bd9195 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:42.743755 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc149-f793-40e1-98cb-52e294bd9195 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:42.744209 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfc149-f793-40e1-98cb-52e294bd9195 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:42.753121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc149-f793-40e1-98cb-52e294bd9195 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:42.754550 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfc149-f793-40e1-98cb-52e294bd9195 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:42.764785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 480/943] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:42 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:45.801821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb7a7-8aae-4834-8724-d84efe1d6998 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:45.802436 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb7a7-8aae-4834-8724-d84efe1d6998 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:45.802740 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9fb7a7-8aae-4834-8724-d84efe1d6998 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:45.805134 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 464/944] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:45 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:45.813272 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff69b2-2187-42d1-bb91-81fd1c95e017 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:45.814071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff69b2-2187-42d1-bb91-81fd1c95e017 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:45.814071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff69b2-2187-42d1-bb91-81fd1c95e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:45.839261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-9eff69b2-2187-42d1-bb91-81fd1c95e017 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:45.840565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-9eff69b2-2187-42d1-bb91-81fd1c95e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:45.849060 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 481/945] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:45 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:45.888742 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb7a7-8aae-4834-8724-d84efe1d6998 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:45.900181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9fb7a7-8aae-4834-8724-d84efe1d6998 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:45.903897 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35ff4-7740-4b97-ab8c-f49ff1060fcf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:45.904867 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35ff4-7740-4b97-ab8c-f49ff1060fcf service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:45.905149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35ff4-7740-4b97-ab8c-f49ff1060fcf service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:45.905422 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35ff4-7740-4b97-ab8c-f49ff1060fcf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:45.915303 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35ff4-7740-4b97-ab8c-f49ff1060fcf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:45.916784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35ff4-7740-4b97-ab8c-f49ff1060fcf service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:45.927213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 465/946] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:45 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:48.287161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648462-07ca-423e-9dfe-a53f3c8219ca None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:48.287795 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648462-07ca-423e-9dfe-a53f3c8219ca None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:48.287904 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9648462-07ca-423e-9dfe-a53f3c8219ca None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:48.289509 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 482/947] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:48 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:48.295048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ceb43-d4da-4d95-94ee-106740a4c8ea None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:48.295551 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ceb43-d4da-4d95-94ee-106740a4c8ea None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:48.295654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87ceb43-d4da-4d95-94ee-106740a4c8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:48.317414 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d87ceb43-d4da-4d95-94ee-106740a4c8ea None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:48.318631 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d87ceb43-d4da-4d95-94ee-106740a4c8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:48.328181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 466/948] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:48.366028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648462-07ca-423e-9dfe-a53f3c8219ca None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:48.378646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9648462-07ca-423e-9dfe-a53f3c8219ca None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:48.382999 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4c8b8-0b35-461f-8a74-3c886ffe2e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:48.383725 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c8b8-0b35-461f-8a74-3c886ffe2e92 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:48.384003 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c8b8-0b35-461f-8a74-3c886ffe2e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:48.384273 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4c8b8-0b35-461f-8a74-3c886ffe2e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:48.395791 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c8b8-0b35-461f-8a74-3c886ffe2e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:48.397268 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4c8b8-0b35-461f-8a74-3c886ffe2e92 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:48.408628 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 483/949] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:48 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:50.707237 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7893a-22de-40d6-9d88-04bf00159319 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:50.707817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7893a-22de-40d6-9d88-04bf00159319 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:50.707817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a7893a-22de-40d6-9d88-04bf00159319 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:50.709314 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 467/950] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:50 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:50.714784 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62e6a-5146-47e9-9eb5-c24567b60475 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:50.715206 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62e6a-5146-47e9-9eb5-c24567b60475 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:50.715463 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e62e6a-5146-47e9-9eb5-c24567b60475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:50.744294 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-b6e62e6a-5146-47e9-9eb5-c24567b60475 None None] MFA Rules not processed for user `a3979e4c2a5e4d198e1d5e640a715e94`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:50.745557 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-b6e62e6a-5146-47e9-9eb5-c24567b60475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:50.756460 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 484/951] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:50 2022] POST /identity/v3/auth/tokens => generated 2801 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:50.801100 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7893a-22de-40d6-9d88-04bf00159319 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:50.813041 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a7893a-22de-40d6-9d88-04bf00159319 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:50.817928 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b943405-2eb8-4ac4-b70a-7027a94a55f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:50.818803 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b943405-2eb8-4ac4-b70a-7027a94a55f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:50.819134 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b943405-2eb8-4ac4-b70a-7027a94a55f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:50.819474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b943405-2eb8-4ac4-b70a-7027a94a55f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:50.831145 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b943405-2eb8-4ac4-b70a-7027a94a55f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:50.832846 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b943405-2eb8-4ac4-b70a-7027a94a55f2 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:50.843080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 468/952] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:50 2022] GET /identity/v3/auth/tokens => generated 2801 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:10:53.354215 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327915e-cf7d-423a-978b-c3f565eb7f41 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:53.354884 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327915e-cf7d-423a-978b-c3f565eb7f41 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:53.354884 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1327915e-cf7d-423a-978b-c3f565eb7f41 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:53.356221 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 485/953] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:53 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:53.362670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007033f3-a97c-43a2-83ef-3681fa3fdfd3 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:53.363503 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007033f3-a97c-43a2-83ef-3681fa3fdfd3 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:53.363503 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007033f3-a97c-43a2-83ef-3681fa3fdfd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:53.384860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-007033f3-a97c-43a2-83ef-3681fa3fdfd3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:53.386224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-007033f3-a97c-43a2-83ef-3681fa3fdfd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:53.396573 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 469/954] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:53 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:53.435047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327915e-cf7d-423a-978b-c3f565eb7f41 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:53.447817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1327915e-cf7d-423a-978b-c3f565eb7f41 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:53.452645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff3f93-9f22-449a-b35d-5def5bd1fbcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:53.453321 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff3f93-9f22-449a-b35d-5def5bd1fbcb service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:53.453608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff3f93-9f22-449a-b35d-5def5bd1fbcb service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:53.453919 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff3f93-9f22-449a-b35d-5def5bd1fbcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:53.467373 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff3f93-9f22-449a-b35d-5def5bd1fbcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:53.468862 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff3f93-9f22-449a-b35d-5def5bd1fbcb service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:53.480430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 486/955] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:53 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:55.848031 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08918584-8ab6-48e7-9037-22906d2d7575 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:55.848601 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08918584-8ab6-48e7-9037-22906d2d7575 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:55.848601 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08918584-8ab6-48e7-9037-22906d2d7575 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:55.850001 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 470/956] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:55 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:55.856320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6bfea-b20a-469d-a234-f6f99625aa9a None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:55.857107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6bfea-b20a-469d-a234-f6f99625aa9a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:55.857293 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe6bfea-b20a-469d-a234-f6f99625aa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:55.878341 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-4fe6bfea-b20a-469d-a234-f6f99625aa9a None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:55.879606 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-4fe6bfea-b20a-469d-a234-f6f99625aa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:55.888933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 487/957] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:55 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:55.933142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08918584-8ab6-48e7-9037-22906d2d7575 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:55.946121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08918584-8ab6-48e7-9037-22906d2d7575 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:55.951463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd908a8-9f19-4744-a5b9-1cebc4004c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:55.952159 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd908a8-9f19-4744-a5b9-1cebc4004c8c service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:55.952435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd908a8-9f19-4744-a5b9-1cebc4004c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:55.952907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd908a8-9f19-4744-a5b9-1cebc4004c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:55.963489 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd908a8-9f19-4744-a5b9-1cebc4004c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:55.964992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd908a8-9f19-4744-a5b9-1cebc4004c8c service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:55.975155 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 471/958] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:55 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:10:58.765276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6fca-e593-4525-8709-a39daeb0a13f None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:58.765810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6fca-e593-4525-8709-a39daeb0a13f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:58.765810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a6fca-e593-4525-8709-a39daeb0a13f None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:58.767173 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 488/959] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:10:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:10:58.775616 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139f6d-25ef-4a42-abd5-434cdda34dc2 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:58.776212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139f6d-25ef-4a42-abd5-434cdda34dc2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:58.776212 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3139f6d-25ef-4a42-abd5-434cdda34dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:58.798662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d3139f6d-25ef-4a42-abd5-434cdda34dc2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:10:58.799919 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d3139f6d-25ef-4a42-abd5-434cdda34dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:10:58.809459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 472/960] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:10:58 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:10:58.847143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6fca-e593-4525-8709-a39daeb0a13f None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:10:58.859694 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a6fca-e593-4525-8709-a39daeb0a13f None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:10:58.864912 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6a7bd7-9c60-404c-820b-38625e00a4d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:10:58.865571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a7bd7-9c60-404c-820b-38625e00a4d0 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:10:58.865853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a7bd7-9c60-404c-820b-38625e00a4d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:10:58.866127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6a7bd7-9c60-404c-820b-38625e00a4d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:10:58.876301 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a7bd7-9c60-404c-820b-38625e00a4d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:10:58.877854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6a7bd7-9c60-404c-820b-38625e00a4d0 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:10:58.887987 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 489/961] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:10:58 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:03.354694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b38cb-8458-4845-8ad6-3d58ee150999 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:03.355295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b38cb-8458-4845-8ad6-3d58ee150999 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:03.355295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b38cb-8458-4845-8ad6-3d58ee150999 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:03.356695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 473/962] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:03.362378 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0fff-dfc1-4513-81bd-adcbd2ea0aa3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:03.362935 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0fff-dfc1-4513-81bd-adcbd2ea0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:03.363082 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed0fff-dfc1-4513-81bd-adcbd2ea0aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:03.387914 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-8eed0fff-dfc1-4513-81bd-adcbd2ea0aa3 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:03.389148 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-8eed0fff-dfc1-4513-81bd-adcbd2ea0aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:03.398644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 490/963] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:03 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:03.440361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b38cb-8458-4845-8ad6-3d58ee150999 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:03.447175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=77 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:03.454140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b38cb-8458-4845-8ad6-3d58ee150999 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:03.458524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62566aee-6762-4ee3-8c44-605f12980b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:03.459239 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566aee-6762-4ee3-8c44-605f12980b20 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:03.459612 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566aee-6762-4ee3-8c44-605f12980b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:03.459946 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62566aee-6762-4ee3-8c44-605f12980b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:03.469884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62566aee-6762-4ee3-8c44-605f12980b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:03.471321 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62566aee-6762-4ee3-8c44-605f12980b20 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:03.481333 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 474/964] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:03 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:06.358781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4408f-840e-4d0a-8dd9-6ed8f4e4ca63 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:06.359281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4408f-840e-4d0a-8dd9-6ed8f4e4ca63 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:06.359414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f4408f-840e-4d0a-8dd9-6ed8f4e4ca63 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:06.360909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 491/965] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:06 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:06.366215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e326-62fd-420e-8941-bb81abd5cfdf None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:06.366651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e326-62fd-420e-8941-bb81abd5cfdf None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:06.366787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437e326-62fd-420e-8941-bb81abd5cfdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:06.387071 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f437e326-62fd-420e-8941-bb81abd5cfdf None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:06.388578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f437e326-62fd-420e-8941-bb81abd5cfdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:06.397732 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 475/966] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:06 2022] POST /identity/v3/auth/tokens => generated 2796 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:06.439947 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4408f-840e-4d0a-8dd9-6ed8f4e4ca63 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:06.451516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f4408f-840e-4d0a-8dd9-6ed8f4e4ca63 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:06.454917 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5a4675-64a4-4abd-93a3-fbc3f1592504 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:06.455643 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4675-64a4-4abd-93a3-fbc3f1592504 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:06.455926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4675-64a4-4abd-93a3-fbc3f1592504 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:06.456196 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5a4675-64a4-4abd-93a3-fbc3f1592504 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:06.466035 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4675-64a4-4abd-93a3-fbc3f1592504 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:06.467576 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5a4675-64a4-4abd-93a3-fbc3f1592504 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:06.478205 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 492/967] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:06 2022] GET /identity/v3/auth/tokens => generated 2796 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:10.881510 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426f9c-f090-465b-816c-e017ad8a2e89 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:10.882109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426f9c-f090-465b-816c-e017ad8a2e89 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:10.882109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae426f9c-f090-465b-816c-e017ad8a2e89 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:10.883485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 476/968] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:10.889098 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ad3d-39cb-42ae-b64b-4419074e311d None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:10.889658 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ad3d-39cb-42ae-b64b-4419074e311d None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:10.889658 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9ad3d-39cb-42ae-b64b-4419074e311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:10.897841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=54 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:10.912263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-53e9ad3d-39cb-42ae-b64b-4419074e311d None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:10.913500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-53e9ad3d-39cb-42ae-b64b-4419074e311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:10.921742 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 493/969] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:10 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:10.963035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426f9c-f090-465b-816c-e017ad8a2e89 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:10.974229 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae426f9c-f090-465b-816c-e017ad8a2e89 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:10.977747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abdd07-d542-4292-ae54-9059f68ca47d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:10.978396 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abdd07-d542-4292-ae54-9059f68ca47d service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:10.979019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abdd07-d542-4292-ae54-9059f68ca47d service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:10.979310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abdd07-d542-4292-ae54-9059f68ca47d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:10.989163 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abdd07-d542-4292-ae54-9059f68ca47d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:10.990631 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78abdd07-d542-4292-ae54-9059f68ca47d service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:11.000992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 477/970] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:10 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:16.709060 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f241b-0085-47ab-8176-c6d5e9884608 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:16.709594 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f241b-0085-47ab-8176-c6d5e9884608 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:16.709594 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f241b-0085-47ab-8176-c6d5e9884608 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:16.711283 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 494/971] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:11:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:16.724821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259c94-81a1-4992-b3e3-3d54b8ab4cc6 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:16.724821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259c94-81a1-4992-b3e3-3d54b8ab4cc6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:16.724821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f259c94-81a1-4992-b3e3-3d54b8ab4cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:16.765767 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-2f259c94-81a1-4992-b3e3-3d54b8ab4cc6 None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:16.767263 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-2f259c94-81a1-4992-b3e3-3d54b8ab4cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:16.889442 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 478/972] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:11:16 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:20.906453 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=2 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:21.391530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df538-a890-462a-9238-e5ff619748da None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:21.391962 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df538-a890-462a-9238-e5ff619748da None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:21.392079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15df538-a890-462a-9238-e5ff619748da None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:21.393815 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 495/973] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:11:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:21.399903 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df23ec-95bb-493f-82e1-aedc2ede8995 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:21.400550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df23ec-95bb-493f-82e1-aedc2ede8995 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:21.400550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df23ec-95bb-493f-82e1-aedc2ede8995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:21.421395 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d3df23ec-95bb-493f-82e1-aedc2ede8995 None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:21.422765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d3df23ec-95bb-493f-82e1-aedc2ede8995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:21.432873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 479/974] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:11:21 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:23.021447 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6493-788a-414a-ac15-69d91ade5f7d None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:23.022018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6493-788a-414a-ac15-69d91ade5f7d None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:23.022110 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5f6493-788a-414a-ac15-69d91ade5f7d None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:23.023596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 496/975] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:11:23 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:23.030811 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506112-1a4b-46e2-83d0-ab1bf35d2433 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:23.031305 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506112-1a4b-46e2-83d0-ab1bf35d2433 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:23.031594 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2506112-1a4b-46e2-83d0-ab1bf35d2433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:23.053347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c2506112-1a4b-46e2-83d0-ab1bf35d2433 None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:23.055540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c2506112-1a4b-46e2-83d0-ab1bf35d2433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:23.068308 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 480/976] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:11:23 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:27.016765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d401-1f04-4e44-9599-ba4610cb54d7 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:27.017757 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d401-1f04-4e44-9599-ba4610cb54d7 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:27.018254 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7d401-1f04-4e44-9599-ba4610cb54d7 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:27.024347 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 497/977] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:27 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:27.025814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131ca1c-5453-499e-84a2-66628efc9fa9 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:27.026247 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131ca1c-5453-499e-84a2-66628efc9fa9 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:27.026410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d131ca1c-5453-499e-84a2-66628efc9fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:27.048478 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-d131ca1c-5453-499e-84a2-66628efc9fa9 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:27.050127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-d131ca1c-5453-499e-84a2-66628efc9fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:27.058435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 481/978] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:27 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:27.121444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfdb67-795c-4882-916f-d31d4a9b0083 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:27.121984 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfdb67-795c-4882-916f-d31d4a9b0083 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:27.122778 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bfdb67-795c-4882-916f-d31d4a9b0083 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:27.126188 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 498/979] 10.222.0.112 () {54 vars in 967 bytes} [Mon Jul 25 19:11:27 2022] GET /identity => generated 271 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:27.135739 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f6a9-424c-4a86-b747-678cadae7f4d None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:27.136398 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f6a9-424c-4a86-b747-678cadae7f4d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:27.136845 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54f6a9-424c-4a86-b747-678cadae7f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:27.182331 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-bc54f6a9-424c-4a86-b747-678cadae7f4d None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:27.183682 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-bc54f6a9-424c-4a86-b747-678cadae7f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:27.257344 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:27.259476 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 482/980] 10.222.0.112 () {58 vars in 1064 bytes} [Mon Jul 25 19:11:27 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:27.267739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfdb67-795c-4882-916f-d31d4a9b0083 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:27.281854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bfdb67-795c-4882-916f-d31d4a9b0083 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:27.294314 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dfffb-634a-4df0-a93d-f38df08ba1e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:27.294968 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dfffb-634a-4df0-a93d-f38df08ba1e7 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:27.295246 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dfffb-634a-4df0-a93d-f38df08ba1e7 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:27.295539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dfffb-634a-4df0-a93d-f38df08ba1e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:27.305543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dfffb-634a-4df0-a93d-f38df08ba1e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:27.308112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021dfffb-634a-4df0-a93d-f38df08ba1e7 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:27.318505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 499/981] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:27 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:29.774596 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe5ad-7170-473e-9ba9-52dbbdd2dcf3 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:29.775495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe5ad-7170-473e-9ba9-52dbbdd2dcf3 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:29.775495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3fe5ad-7170-473e-9ba9-52dbbdd2dcf3 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:29.781044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 483/982] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:29.783974 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee940a38-9547-40b9-ab62-0cd0979bc9bd None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:29.784838 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee940a38-9547-40b9-ab62-0cd0979bc9bd None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:29.785316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee940a38-9547-40b9-ab62-0cd0979bc9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:29.808703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-ee940a38-9547-40b9-ab62-0cd0979bc9bd None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:29.809890 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-ee940a38-9547-40b9-ab62-0cd0979bc9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:29.819036 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 500/983] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:29 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:29.863692 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe5ad-7170-473e-9ba9-52dbbdd2dcf3 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:29.878463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3fe5ad-7170-473e-9ba9-52dbbdd2dcf3 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:29.884409 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e3fbc-fa2e-48f1-bc30-c5e1e7df1433 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:29.885141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3fbc-fa2e-48f1-bc30-c5e1e7df1433 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:29.885499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3fbc-fa2e-48f1-bc30-c5e1e7df1433 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:29.885841 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e3fbc-fa2e-48f1-bc30-c5e1e7df1433 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:29.895359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e3fbc-fa2e-48f1-bc30-c5e1e7df1433 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:29.897061 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e3fbc-fa2e-48f1-bc30-c5e1e7df1433 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:29.906868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 484/984] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:29 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:32.500880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe84b3-e3a7-40a9-8df4-b94d835819f4 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:32.501723 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe84b3-e3a7-40a9-8df4-b94d835819f4 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:32.502001 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe84b3-e3a7-40a9-8df4-b94d835819f4 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:32.503907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 501/985] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:32 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:32.509781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944115fa-4f1b-4fac-9e60-8c972bb805b2 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:32.510236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944115fa-4f1b-4fac-9e60-8c972bb805b2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:32.510319 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944115fa-4f1b-4fac-9e60-8c972bb805b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:32.531250 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-944115fa-4f1b-4fac-9e60-8c972bb805b2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:32.532536 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-944115fa-4f1b-4fac-9e60-8c972bb805b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:32.540671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 485/986] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:32 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:32.587752 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b41efb-826d-46ce-b363-8b604e2f299f None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:32.589151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b41efb-826d-46ce-b363-8b604e2f299f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:32.589151 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b41efb-826d-46ce-b363-8b604e2f299f None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:32.590685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 502/987] 10.222.0.112 () {54 vars in 967 bytes} [Mon Jul 25 19:11:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:32.598623 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a05f1-a608-42b0-ae01-d2b90a8c6b9d None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:32.598623 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a05f1-a608-42b0-ae01-d2b90a8c6b9d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:32.598623 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a05f1-a608-42b0-ae01-d2b90a8c6b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:32.617221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-151a05f1-a608-42b0-ae01-d2b90a8c6b9d None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:32.618416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-151a05f1-a608-42b0-ae01-d2b90a8c6b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:32.627993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 486/988] 10.222.0.112 () {58 vars in 1064 bytes} [Mon Jul 25 19:11:32 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:32.636705 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b41efb-826d-46ce-b363-8b604e2f299f None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:32.651061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b41efb-826d-46ce-b363-8b604e2f299f None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:32.656261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f6e14c-f48d-4ef9-90d5-8735bbad4466 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:32.656898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6e14c-f48d-4ef9-90d5-8735bbad4466 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:32.657179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6e14c-f48d-4ef9-90d5-8735bbad4466 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:32.657478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f6e14c-f48d-4ef9-90d5-8735bbad4466 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:32.665476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6e14c-f48d-4ef9-90d5-8735bbad4466 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:32.667085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f6e14c-f48d-4ef9-90d5-8735bbad4466 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:32.678595 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 503/989] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:32 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:35.045164 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9727-5838-4cfc-9771-66e24e48da58 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:35.045690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9727-5838-4cfc-9771-66e24e48da58 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:35.045690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9727-5838-4cfc-9771-66e24e48da58 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:35.047377 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 487/990] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:35 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:35.052681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ee12-5a99-4d0d-9089-19b77e303a73 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:35.053470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ee12-5a99-4d0d-9089-19b77e303a73 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:35.053800 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6ee12-5a99-4d0d-9089-19b77e303a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:35.075249 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-40a6ee12-5a99-4d0d-9089-19b77e303a73 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:35.076411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-40a6ee12-5a99-4d0d-9089-19b77e303a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:35.084982 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 504/991] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:35 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:35.139429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9727-5838-4cfc-9771-66e24e48da58 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:35.157766 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9727-5838-4cfc-9771-66e24e48da58 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:35.169269 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed830131-f5d3-4ade-96f1-c5810510edce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:35.170207 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830131-f5d3-4ade-96f1-c5810510edce service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:35.170646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830131-f5d3-4ade-96f1-c5810510edce service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:35.171074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed830131-f5d3-4ade-96f1-c5810510edce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:35.184230 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830131-f5d3-4ade-96f1-c5810510edce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:35.186118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed830131-f5d3-4ade-96f1-c5810510edce service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:35.198091 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 488/992] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:35 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:37.634823 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f49f4c-e3ae-4a48-af06-70ab64284e7f None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.635476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f49f4c-e3ae-4a48-af06-70ab64284e7f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.635476 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f49f4c-e3ae-4a48-af06-70ab64284e7f None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.636717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 505/993] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:37.642901 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f9f2-08bc-4ead-9bed-2399a9c1c817 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.643443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f9f2-08bc-4ead-9bed-2399a9c1c817 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.643544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76f9f2-08bc-4ead-9bed-2399a9c1c817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.664390 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-0f76f9f2-08bc-4ead-9bed-2399a9c1c817 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:37.665597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-0f76f9f2-08bc-4ead-9bed-2399a9c1c817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:37.674601 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 489/994] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:37.732962 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c26a-196b-4732-89ed-722ec5b8093b None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.733261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c26a-196b-4732-89ed-722ec5b8093b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.733500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d087c26a-196b-4732-89ed-722ec5b8093b None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.735133 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 506/995] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:37.741771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27345-e736-453e-9d3d-1a236be0da52 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.742240 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27345-e736-453e-9d3d-1a236be0da52 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.742702 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a27345-e736-453e-9d3d-1a236be0da52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.767865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a7a27345-e736-453e-9d3d-1a236be0da52 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:37.769056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a7a27345-e736-453e-9d3d-1a236be0da52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:37.778392 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 490/996] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:37.834991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087c26a-196b-4732-89ed-722ec5b8093b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:37.856780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d087c26a-196b-4732-89ed-722ec5b8093b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:37.862609 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bb401d-a2f1-4e51-9877-d17ae36977f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:37.863274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb401d-a2f1-4e51-9877-d17ae36977f1 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.863569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb401d-a2f1-4e51-9877-d17ae36977f1 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.863877 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bb401d-a2f1-4e51-9877-d17ae36977f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.873368 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb401d-a2f1-4e51-9877-d17ae36977f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:37.875095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bb401d-a2f1-4e51-9877-d17ae36977f1 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:37.886624 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 507/997] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:37 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:37.965791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b378-f25c-4df4-8062-6602cbd682a0 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.966086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b378-f25c-4df4-8062-6602cbd682a0 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.966418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4361b378-f25c-4df4-8062-6602cbd682a0 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:37.968117 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 491/998] 10.222.0.112 () {54 vars in 969 bytes} [Mon Jul 25 19:11:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:37.977508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb107d-4c18-4e27-8526-057cfa3f4b59 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:37.977801 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb107d-4c18-4e27-8526-057cfa3f4b59 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:37.978145 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb107d-4c18-4e27-8526-057cfa3f4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:38.032887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-a8fb107d-4c18-4e27-8526-057cfa3f4b59 None None] MFA Rules not processed for user `54ea2fbc34f9488e8a431acf95db792f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:38.034242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-a8fb107d-4c18-4e27-8526-057cfa3f4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:38.121846 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 508/999] 10.222.0.112 () {58 vars in 1066 bytes} [Mon Jul 25 19:11:37 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:38.130336 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361b378-f25c-4df4-8062-6602cbd682a0 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:38.143858 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4361b378-f25c-4df4-8062-6602cbd682a0 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:38.147729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a3d0ab-8d87-44b9-bc2b-68ecf4bf2241 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54ea2fbc34f9488e8a431acf95db792f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:38.148396 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3d0ab-8d87-44b9-bc2b-68ecf4bf2241 service cinder] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:38.148679 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3d0ab-8d87-44b9-bc2b-68ecf4bf2241 service cinder] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:38.148954 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a3d0ab-8d87-44b9-bc2b-68ecf4bf2241 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:38.163836 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3d0ab-8d87-44b9-bc2b-68ecf4bf2241 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:38.165298 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a3d0ab-8d87-44b9-bc2b-68ecf4bf2241 service cinder] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:38.176874 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 492/1000] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:38 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:40.250444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81de7c8-f03f-4e22-99b5-c9548ad7d01c None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:40.250976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81de7c8-f03f-4e22-99b5-c9548ad7d01c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:40.250976 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81de7c8-f03f-4e22-99b5-c9548ad7d01c None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:40.252399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 509/1001] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:40 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:40.258004 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a854e-24f8-4661-84ea-275abeaaa70d None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:40.258472 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a854e-24f8-4661-84ea-275abeaaa70d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:40.258570 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a854e-24f8-4661-84ea-275abeaaa70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:40.278791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-7e7a854e-24f8-4661-84ea-275abeaaa70d None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:40.280021 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-7e7a854e-24f8-4661-84ea-275abeaaa70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:40.288902 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 493/1002] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:40 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:40.335570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81de7c8-f03f-4e22-99b5-c9548ad7d01c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:40.351266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81de7c8-f03f-4e22-99b5-c9548ad7d01c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:40.356645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e9d06-8cb2-44df-84c5-b827e9d25c94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:40.357295 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9d06-8cb2-44df-84c5-b827e9d25c94 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:40.357571 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9d06-8cb2-44df-84c5-b827e9d25c94 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:40.358320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e9d06-8cb2-44df-84c5-b827e9d25c94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:40.366758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e9d06-8cb2-44df-84c5-b827e9d25c94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:40.368363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e9d06-8cb2-44df-84c5-b827e9d25c94 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:40.379500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 510/1003] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:40 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:42.780689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac87a-952d-4173-9a32-d87151baa579 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:42.781374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac87a-952d-4173-9a32-d87151baa579 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:42.781374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980ac87a-952d-4173-9a32-d87151baa579 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:42.782644 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 494/1004] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:42 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:42.788186 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82778c3-2098-43a2-8cd1-cc6d51457c6e None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:42.788690 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82778c3-2098-43a2-8cd1-cc6d51457c6e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:42.788793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82778c3-2098-43a2-8cd1-cc6d51457c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:42.810109 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-c82778c3-2098-43a2-8cd1-cc6d51457c6e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:42.811299 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-c82778c3-2098-43a2-8cd1-cc6d51457c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:42.826731 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 511/1005] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:42 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:42.871983 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ac87a-952d-4173-9a32-d87151baa579 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:42.886008 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980ac87a-952d-4173-9a32-d87151baa579 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:42.891731 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31327630-7820-4c22-aeed-09e582ff0fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:42.892374 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327630-7820-4c22-aeed-09e582ff0fac service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:42.892662 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327630-7820-4c22-aeed-09e582ff0fac service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:42.892921 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31327630-7820-4c22-aeed-09e582ff0fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:42.902164 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327630-7820-4c22-aeed-09e582ff0fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:42.903807 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31327630-7820-4c22-aeed-09e582ff0fac service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:42.914455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 495/1006] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:42 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:45.509556 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f1534-a7ed-4d0e-bd0c-21aeba4d985b None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:45.510087 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f1534-a7ed-4d0e-bd0c-21aeba4d985b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:45.510367 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785f1534-a7ed-4d0e-bd0c-21aeba4d985b None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:45.513013 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 512/1007] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:45 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:45.518873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ced33-7975-4e75-9028-04e77136b7e1 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:45.519345 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ced33-7975-4e75-9028-04e77136b7e1 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:45.519457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ced33-7975-4e75-9028-04e77136b7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:45.545064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-660ced33-7975-4e75-9028-04e77136b7e1 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:45.546249 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-660ced33-7975-4e75-9028-04e77136b7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:45.556435 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 496/1008] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:45 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:45.604217 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f1534-a7ed-4d0e-bd0c-21aeba4d985b None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:45.619635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785f1534-a7ed-4d0e-bd0c-21aeba4d985b None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:45.625723 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5834d98-c11b-46a0-8ee7-8388ef920e26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:45.626454 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5834d98-c11b-46a0-8ee7-8388ef920e26 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:45.626820 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5834d98-c11b-46a0-8ee7-8388ef920e26 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:45.627163 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5834d98-c11b-46a0-8ee7-8388ef920e26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:45.636478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5834d98-c11b-46a0-8ee7-8388ef920e26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:45.638149 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5834d98-c11b-46a0-8ee7-8388ef920e26 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:45.649089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 513/1009] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:45 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:48.319824 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb10d9-cd32-48e0-b538-9edb6c8a359c None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:48.320432 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb10d9-cd32-48e0-b538-9edb6c8a359c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:48.320541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfb10d9-cd32-48e0-b538-9edb6c8a359c None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:48.322305 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 497/1010] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:48 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:48.329392 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818700-333e-4dd1-be2b-01d778d2c3e1 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:48.329853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818700-333e-4dd1-be2b-01d778d2c3e1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:48.329953 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23818700-333e-4dd1-be2b-01d778d2c3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:48.350543 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-23818700-333e-4dd1-be2b-01d778d2c3e1 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:48.351802 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-23818700-333e-4dd1-be2b-01d778d2c3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:48.360824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 514/1011] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:48 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:48.409836 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb10d9-cd32-48e0-b538-9edb6c8a359c None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:48.428743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfb10d9-cd32-48e0-b538-9edb6c8a359c None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:48.436009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10171bd-d52d-4187-922a-4ed6d14d21d6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:48.437187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10171bd-d52d-4187-922a-4ed6d14d21d6 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:48.437553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10171bd-d52d-4187-922a-4ed6d14d21d6 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:48.437896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10171bd-d52d-4187-922a-4ed6d14d21d6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:48.449798 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10171bd-d52d-4187-922a-4ed6d14d21d6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:48.452159 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10171bd-d52d-4187-922a-4ed6d14d21d6 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:48.465114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 498/1012] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:48 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:51.700541 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f44fd-c316-4385-add4-4d2cd60a7a94 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:51.701967 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f44fd-c316-4385-add4-4d2cd60a7a94 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:51.701967 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580f44fd-c316-4385-add4-4d2cd60a7a94 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:51.702592 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 515/1013] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:51 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:51.708221 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ecb28-b8a2-47cb-a0d1-3b14c1e06848 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:51.709411 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ecb28-b8a2-47cb-a0d1-3b14c1e06848 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:51.709411 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ecb28-b8a2-47cb-a0d1-3b14c1e06848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:51.728599 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-be7ecb28-b8a2-47cb-a0d1-3b14c1e06848 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:51.729728 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-be7ecb28-b8a2-47cb-a0d1-3b14c1e06848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:51.737634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 499/1014] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:51 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:51.784868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f44fd-c316-4385-add4-4d2cd60a7a94 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:51.793090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=76 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:11:51.801361 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580f44fd-c316-4385-add4-4d2cd60a7a94 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:51.807266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b808c3ef-45ec-44cd-9f0a-1c851726cc60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:51.808021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808c3ef-45ec-44cd-9f0a-1c851726cc60 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:51.808341 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808c3ef-45ec-44cd-9f0a-1c851726cc60 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:51.808681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b808c3ef-45ec-44cd-9f0a-1c851726cc60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:51.819239 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808c3ef-45ec-44cd-9f0a-1c851726cc60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:51.821345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b808c3ef-45ec-44cd-9f0a-1c851726cc60 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:51.832379 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 516/1015] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:51 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:11:54.291777 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15f9f-8511-4237-8d4b-2aeca93312bc None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.292483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15f9f-8511-4237-8d4b-2aeca93312bc None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.292483 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa15f9f-8511-4237-8d4b-2aeca93312bc None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.293707 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 500/1016] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:54.299228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.299813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.299813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.302492 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1537e-d426-4597-802e-34a055d58e7f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.302817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1537e-d426-4597-802e-34a055d58e7f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.303042 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1537e-d426-4597-802e-34a055d58e7f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.304361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 501/1017] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:54.309437 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857d95-74b0-47a3-9a8e-c71f146d024a None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.309730 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857d95-74b0-47a3-9a8e-c71f146d024a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.309983 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18857d95-74b0-47a3-9a8e-c71f146d024a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.321092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:54.322292 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:54.329689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-18857d95-74b0-47a3-9a8e-c71f146d024a None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:54.330839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-18857d95-74b0-47a3-9a8e-c71f146d024a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:54.331415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 517/1018] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:54 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:11:54.339110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 502/1019] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:54 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:54.385545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:54.388418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c14a6c-c266-477c-babb-bb10f2e3ae55 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.388783 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c14a6c-c266-477c-babb-bb10f2e3ae55 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.389061 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c14a6c-c266-477c-babb-bb10f2e3ae55 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.390517 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 503/1020] 10.222.0.112 () {54 vars in 971 bytes} [Mon Jul 25 19:11:54 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:11:54.395201 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeda71-7d92-422d-805b-8f97e20dde93 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.395541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeda71-7d92-422d-805b-8f97e20dde93 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.395822 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caeda71-7d92-422d-805b-8f97e20dde93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.398194 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c399709-7d49-40b2-b810-e7f3cc1a4079 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:54.404123 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:54.404809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.405093 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.405369 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.414425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:54.416433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:54.427647 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 518/1021] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:54 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:54.438934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-9caeda71-7d92-422d-805b-8f97e20dde93 None None] MFA Rules not processed for user `fbb8bab39c68414b8db430d75072f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:54.440160 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-9caeda71-7d92-422d-805b-8f97e20dde93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:54.507048 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 504/1022] 10.222.0.112 () {58 vars in 1068 bytes} [Mon Jul 25 19:11:54 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:54.515470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:54.525858 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c80efd-a9e6-4b99-9c49-d2cc0555ac10 service nova] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:54.530168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a4e59-a7f5-41c6-a9bd-af9de0e0a81b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbb8bab39c68414b8db430d75072f892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:54.530841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4e59-a7f5-41c6-a9bd-af9de0e0a81b service glance] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:54.531121 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4e59-a7f5-41c6-a9bd-af9de0e0a81b service glance] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:54.531427 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a4e59-a7f5-41c6-a9bd-af9de0e0a81b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:54.542608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a4e59-a7f5-41c6-a9bd-af9de0e0a81b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:54.544011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a4e59-a7f5-41c6-a9bd-af9de0e0a81b service glance] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:54.555228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 519/1023] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:54 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:11:56.786625 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf435c8-9b04-44be-a9d8-bbb842b54a3d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:56.787274 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf435c8-9b04-44be-a9d8-bbb842b54a3d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:56.787274 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf435c8-9b04-44be-a9d8-bbb842b54a3d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:56.788648 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 505/1024] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:11:56 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:11:56.794599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bab6-75fa-46bf-b6e6-951850925ffd None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:56.795098 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bab6-75fa-46bf-b6e6-951850925ffd None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:56.795209 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322bab6-75fa-46bf-b6e6-951850925ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:56.815707 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-2322bab6-75fa-46bf-b6e6-951850925ffd None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:11:56.816939 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-2322bab6-75fa-46bf-b6e6-951850925ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:11:56.831433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 520/1025] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:11:56 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:11:56.873365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf435c8-9b04-44be-a9d8-bbb842b54a3d None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:11:56.896757 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf435c8-9b04-44be-a9d8-bbb842b54a3d None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:11:56.906561 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcdfdd3-b38d-4339-97bf-1f1cdf295919 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:11:56.907226 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdfdd3-b38d-4339-97bf-1f1cdf295919 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:11:56.907541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdfdd3-b38d-4339-97bf-1f1cdf295919 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:11:56.907814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcdfdd3-b38d-4339-97bf-1f1cdf295919 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:11:56.917617 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdfdd3-b38d-4339-97bf-1f1cdf295919 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:11:56.919267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcdfdd3-b38d-4339-97bf-1f1cdf295919 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:11:56.929941 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 506/1026] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:11:56 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:06.809685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=23 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:06.925150 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=94 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:09.942656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627481b1-af4f-4d6a-aa9d-9df5d0660168 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:09.943421 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627481b1-af4f-4d6a-aa9d-9df5d0660168 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:09.943421 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627481b1-af4f-4d6a-aa9d-9df5d0660168 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:09.945093 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 521/1027] 10.222.0.112 () {54 vars in 923 bytes} [Mon Jul 25 19:12:09 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:09.951562 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692745-0fe7-4bf8-85fd-29c421dd437a None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:09.952227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692745-0fe7-4bf8-85fd-29c421dd437a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:09.952227 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c692745-0fe7-4bf8-85fd-29c421dd437a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:09.974261 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-0c692745-0fe7-4bf8-85fd-29c421dd437a None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:09.975625 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-0c692745-0fe7-4bf8-85fd-29c421dd437a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:09.986223 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 507/1028] 10.222.0.112 () {58 vars in 1020 bytes} [Mon Jul 25 19:12:09 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:10.001068 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347559b-8b84-41d9-be46-33df7acce040 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:10.001359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347559b-8b84-41d9-be46-33df7acce040 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:10.001638 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347559b-8b84-41d9-be46-33df7acce040 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:10.003069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 522/1029] 10.222.0.112 () {54 vars in 923 bytes} [Mon Jul 25 19:12:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:10.008376 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb366b9-1723-489c-a3bf-e895235c97db None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:10.008669 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb366b9-1723-489c-a3bf-e895235c97db None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:10.008946 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb366b9-1723-489c-a3bf-e895235c97db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:10.029824 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-deb366b9-1723-489c-a3bf-e895235c97db None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:10.031078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-deb366b9-1723-489c-a3bf-e895235c97db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:10.042710 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 508/1030] 10.222.0.112 () {58 vars in 1020 bytes} [Mon Jul 25 19:12:10 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:12.825317 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4f7b3-8419-43d2-89b4-1f6a797082cc None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:12.825734 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4f7b3-8419-43d2-89b4-1f6a797082cc None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:12.825878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4f7b3-8419-43d2-89b4-1f6a797082cc None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:12.827303 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 523/1031] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:12.832723 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066dd76-f132-49de-869d-d576c88ffd6c None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:12.833167 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066dd76-f132-49de-869d-d576c88ffd6c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:12.833363 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066dd76-f132-49de-869d-d576c88ffd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:12.856711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-2066dd76-f132-49de-869d-d576c88ffd6c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:12.857920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-2066dd76-f132-49de-869d-d576c88ffd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:12.867030 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 509/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:12 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:12.912207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4f7b3-8419-43d2-89b4-1f6a797082cc None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:12.928893 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4f7b3-8419-43d2-89b4-1f6a797082cc None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:12.934396 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317654bb-3eca-4a29-a252-af186159b337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:12.935050 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317654bb-3eca-4a29-a252-af186159b337 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:12.935336 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317654bb-3eca-4a29-a252-af186159b337 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:12.935645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317654bb-3eca-4a29-a252-af186159b337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:12.945074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317654bb-3eca-4a29-a252-af186159b337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:12.946764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317654bb-3eca-4a29-a252-af186159b337 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:12.959412 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 524/1033] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:12 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:13.961026 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267902b-0cf5-4685-8359-3fefb2acc65c None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:13.961630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267902b-0cf5-4685-8359-3fefb2acc65c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:13.961630 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2267902b-0cf5-4685-8359-3fefb2acc65c None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:13.963022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 510/1034] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:13.969227 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b357-11d8-4b02-810d-e2f4548c01b2 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:13.969999 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b357-11d8-4b02-810d-e2f4548c01b2 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:13.970203 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878b357-11d8-4b02-810d-e2f4548c01b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:14.001098 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-1878b357-11d8-4b02-810d-e2f4548c01b2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:14.003015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-1878b357-11d8-4b02-810d-e2f4548c01b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:14.012463 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 525/1035] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:13 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:12:14.251986 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267902b-0cf5-4685-8359-3fefb2acc65c None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:14.266863 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2267902b-0cf5-4685-8359-3fefb2acc65c None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:14.272209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab989898-45d1-4088-a185-c3fd63679f69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:14.272861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989898-45d1-4088-a185-c3fd63679f69 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:14.273136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989898-45d1-4088-a185-c3fd63679f69 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:14.273437 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab989898-45d1-4088-a185-c3fd63679f69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:14.283209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989898-45d1-4088-a185-c3fd63679f69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:14.284875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab989898-45d1-4088-a185-c3fd63679f69 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:14.297839 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 511/1036] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:14 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:15.279857 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269322-9acb-41ab-b828-541b68dbad36 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:15.280765 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269322-9acb-41ab-b828-541b68dbad36 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:15.281095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87269322-9acb-41ab-b828-541b68dbad36 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:15.282658 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 526/1037] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:15.289674 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4991e3-a431-49fc-977f-730b64b31ccc None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:15.290326 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4991e3-a431-49fc-977f-730b64b31ccc None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:15.290598 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4991e3-a431-49fc-977f-730b64b31ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:15.316884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-cd4991e3-a431-49fc-977f-730b64b31ccc None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:15.318115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-cd4991e3-a431-49fc-977f-730b64b31ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:15.331476 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 512/1038] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:15 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:15.496193 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87269322-9acb-41ab-b828-541b68dbad36 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:15.511449 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87269322-9acb-41ab-b828-541b68dbad36 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:15.518218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e38684-384f-4d3e-9eb4-f03c8863554b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:15.519227 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38684-384f-4d3e-9eb4-f03c8863554b service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:15.519755 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38684-384f-4d3e-9eb4-f03c8863554b service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:15.520166 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e38684-384f-4d3e-9eb4-f03c8863554b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:15.530692 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38684-384f-4d3e-9eb4-f03c8863554b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:15.533241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e38684-384f-4d3e-9eb4-f03c8863554b service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:15.548335 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 527/1039] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:15 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:16.493423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218003a-86a0-4477-9de6-891743f35eb6 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:16.494019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218003a-86a0-4477-9de6-891743f35eb6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:16.494019 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218003a-86a0-4477-9de6-891743f35eb6 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:16.495365 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 513/1040] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:16 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:16.500539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc38e9-9421-43f6-9405-4ae27318e029 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:16.500964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc38e9-9421-43f6-9405-4ae27318e029 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:16.501074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc38e9-9421-43f6-9405-4ae27318e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:16.521504 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-dcbc38e9-9421-43f6-9405-4ae27318e029 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:16.522670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-dcbc38e9-9421-43f6-9405-4ae27318e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:16.531195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 528/1041] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:16 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:16.698405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218003a-86a0-4477-9de6-891743f35eb6 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:16.713431 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218003a-86a0-4477-9de6-891743f35eb6 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:16.718900 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830450e-41c2-46bf-8ff6-419b50b29ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:16.719595 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830450e-41c2-46bf-8ff6-419b50b29ff2 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:16.719878 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830450e-41c2-46bf-8ff6-419b50b29ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:16.720156 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830450e-41c2-46bf-8ff6-419b50b29ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:16.729389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830450e-41c2-46bf-8ff6-419b50b29ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:16.731110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830450e-41c2-46bf-8ff6-419b50b29ff2 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:16.740931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 514/1042] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:16 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:17.634222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae87b5c-520c-4eac-bf58-e1192beda2d7 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:17.635085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae87b5c-520c-4eac-bf58-e1192beda2d7 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:17.635085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae87b5c-520c-4eac-bf58-e1192beda2d7 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:17.636682 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 529/1043] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:17 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:17.644047 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f4de-5fc3-4652-acff-ff4e05f02b1c None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:17.644485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f4de-5fc3-4652-acff-ff4e05f02b1c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:17.644606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232f4de-5fc3-4652-acff-ff4e05f02b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:17.669608 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-1232f4de-5fc3-4652-acff-ff4e05f02b1c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:17.670844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-1232f4de-5fc3-4652-acff-ff4e05f02b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:17.680264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 515/1044] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:17 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:17.841005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae87b5c-520c-4eac-bf58-e1192beda2d7 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:17.856439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae87b5c-520c-4eac-bf58-e1192beda2d7 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:17.862275 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce583184-66f6-4909-b84d-89bfc921fe45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:17.862909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce583184-66f6-4909-b84d-89bfc921fe45 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:17.863192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce583184-66f6-4909-b84d-89bfc921fe45 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:17.863498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce583184-66f6-4909-b84d-89bfc921fe45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:17.872169 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce583184-66f6-4909-b84d-89bfc921fe45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:17.873751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce583184-66f6-4909-b84d-89bfc921fe45 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:17.883790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 530/1045] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:17 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:18.703464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352470b6-c987-401e-a995-117714e95a60 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:18.704253 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352470b6-c987-401e-a995-117714e95a60 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:18.704253 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352470b6-c987-401e-a995-117714e95a60 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:18.706105 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 516/1046] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:18.714161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86466-4c7d-4463-b505-5caf209319b9 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:18.714855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86466-4c7d-4463-b505-5caf209319b9 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:18.715021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb86466-4c7d-4463-b505-5caf209319b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:18.742714 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-0bb86466-4c7d-4463-b505-5caf209319b9 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:18.744156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-0bb86466-4c7d-4463-b505-5caf209319b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:18.753297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 531/1047] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:18 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:18.912622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352470b6-c987-401e-a995-117714e95a60 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:18.929315 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352470b6-c987-401e-a995-117714e95a60 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:18.934988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8461284-2ba8-43b7-8bd5-1c80a60fbfdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:18.935669 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461284-2ba8-43b7-8bd5-1c80a60fbfdc service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:18.935955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461284-2ba8-43b7-8bd5-1c80a60fbfdc service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:18.936232 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8461284-2ba8-43b7-8bd5-1c80a60fbfdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:18.945724 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8461284-2ba8-43b7-8bd5-1c80a60fbfdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:18.947349 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8461284-2ba8-43b7-8bd5-1c80a60fbfdc service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:18.957147 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 517/1048] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:18 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:19.768721 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1176-24e1-46dc-89d7-1eb199b4ae21 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:19.769400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1176-24e1-46dc-89d7-1eb199b4ae21 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:19.769400 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d1176-24e1-46dc-89d7-1eb199b4ae21 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:19.770641 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 532/1049] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:19 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:19.775811 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8b12-a63f-4226-8093-dd066ddd7bbc None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:19.776279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8b12-a63f-4226-8093-dd066ddd7bbc None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:19.776378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0d8b12-a63f-4226-8093-dd066ddd7bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:19.797597 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-ee0d8b12-a63f-4226-8093-dd066ddd7bbc None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:19.798797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-ee0d8b12-a63f-4226-8093-dd066ddd7bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:19.807963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 518/1050] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:19 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:19.966190 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1176-24e1-46dc-89d7-1eb199b4ae21 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:19.984801 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d1176-24e1-46dc-89d7-1eb199b4ae21 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:19.990813 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23465ac7-7179-47a4-a72b-c23f1f7e33fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:19.991501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465ac7-7179-47a4-a72b-c23f1f7e33fa service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:19.991787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465ac7-7179-47a4-a72b-c23f1f7e33fa service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:19.992064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23465ac7-7179-47a4-a72b-c23f1f7e33fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:20.001056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23465ac7-7179-47a4-a72b-c23f1f7e33fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:20.002640 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23465ac7-7179-47a4-a72b-c23f1f7e33fa service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:20.012634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 533/1051] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:19 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:20.847852 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e089b-1aa7-44cd-96a2-965d90a9db7d None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:20.848416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e089b-1aa7-44cd-96a2-965d90a9db7d None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:20.848416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e089b-1aa7-44cd-96a2-965d90a9db7d None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:20.849788 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 519/1052] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:20 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:20.855043 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b670-72a9-4670-ae13-8aae74ba9f36 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:20.855548 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b670-72a9-4670-ae13-8aae74ba9f36 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:20.855645 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516b670-72a9-4670-ae13-8aae74ba9f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:20.876979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-2516b670-72a9-4670-ae13-8aae74ba9f36 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:20.878156 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-2516b670-72a9-4670-ae13-8aae74ba9f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:20.887186 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 534/1053] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:20 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:21.045873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e089b-1aa7-44cd-96a2-965d90a9db7d None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:21.061094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e089b-1aa7-44cd-96a2-965d90a9db7d None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:21.066715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2b31c-1492-4fdc-b6da-804006e49fe1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:21.067443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2b31c-1492-4fdc-b6da-804006e49fe1 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:21.067747 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2b31c-1492-4fdc-b6da-804006e49fe1 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:21.068021 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2b31c-1492-4fdc-b6da-804006e49fe1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:21.076719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2b31c-1492-4fdc-b6da-804006e49fe1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:21.078342 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2b31c-1492-4fdc-b6da-804006e49fe1 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:21.088305 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 520/1054] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:21 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:21.900305 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb185b-ed5e-4a53-8655-c7cbec56760a None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:21.900905 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb185b-ed5e-4a53-8655-c7cbec56760a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:21.900905 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb185b-ed5e-4a53-8655-c7cbec56760a None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:21.902262 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 535/1055] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:12:21 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:21.907695 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db263843-19c4-49fc-a127-3b1794f316a6 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:21.908118 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db263843-19c4-49fc-a127-3b1794f316a6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:21.908224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db263843-19c4-49fc-a127-3b1794f316a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:21.929327 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-db263843-19c4-49fc-a127-3b1794f316a6 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:21.930542 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-db263843-19c4-49fc-a127-3b1794f316a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:21.939322 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 521/1056] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:12:21 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:22.100002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb185b-ed5e-4a53-8655-c7cbec56760a None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:22.116241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb185b-ed5e-4a53-8655-c7cbec56760a None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:22.122642 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8932e887-639e-4c3d-854e-1526e8e879c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:22.123702 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e887-639e-4c3d-854e-1526e8e879c9 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:22.124249 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e887-639e-4c3d-854e-1526e8e879c9 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:22.124619 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8932e887-639e-4c3d-854e-1526e8e879c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:22.138102 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932e887-639e-4c3d-854e-1526e8e879c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:22.139724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8932e887-639e-4c3d-854e-1526e8e879c9 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:22.150411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 536/1057] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:22 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:24.340391 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e054-1652-491c-a09f-962ce61a7da2 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:24.341092 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e054-1652-491c-a09f-962ce61a7da2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:24.341092 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a0e054-1652-491c-a09f-962ce61a7da2 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:24.342348 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 522/1058] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:24 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:24.348404 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab63acf-462d-4ff5-b421-dd00b5c02139 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:24.348898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab63acf-462d-4ff5-b421-dd00b5c02139 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:24.349009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab63acf-462d-4ff5-b421-dd00b5c02139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:24.368934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-7ab63acf-462d-4ff5-b421-dd00b5c02139 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:24.370216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-7ab63acf-462d-4ff5-b421-dd00b5c02139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:24.378636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 537/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:24 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:24.420749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0e054-1652-491c-a09f-962ce61a7da2 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:24.436433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a0e054-1652-491c-a09f-962ce61a7da2 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:24.440733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb26578-d961-47d9-be4c-9a91c93c0c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:24.441381 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb26578-d961-47d9-be4c-9a91c93c0c7b service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:24.441638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb26578-d961-47d9-be4c-9a91c93c0c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:24.441920 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb26578-d961-47d9-be4c-9a91c93c0c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:24.452057 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb26578-d961-47d9-be4c-9a91c93c0c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:24.453622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb26578-d961-47d9-be4c-9a91c93c0c7b service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:24.464348 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 523/1060] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:24 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:26.903255 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554b39-36e7-48d0-8ca3-ffea6677ba71 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:26.903878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554b39-36e7-48d0-8ca3-ffea6677ba71 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:26.903878 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f554b39-36e7-48d0-8ca3-ffea6677ba71 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:26.905562 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 538/1061] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:26.911424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203351-149f-4c49-b0e4-5e167897e77f None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:26.911862 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203351-149f-4c49-b0e4-5e167897e77f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:26.911955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a203351-149f-4c49-b0e4-5e167897e77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:26.933968 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-0a203351-149f-4c49-b0e4-5e167897e77f None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:26.935173 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-0a203351-149f-4c49-b0e4-5e167897e77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:26.943968 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 524/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:26 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:26.983278 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554b39-36e7-48d0-8ca3-ffea6677ba71 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:26.995859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f554b39-36e7-48d0-8ca3-ffea6677ba71 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:26.999722 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09a83a-0180-432a-9b0a-8c732150a707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:27.000363 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a83a-0180-432a-9b0a-8c732150a707 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:27.000646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a83a-0180-432a-9b0a-8c732150a707 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:27.000998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09a83a-0180-432a-9b0a-8c732150a707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:27.010862 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09a83a-0180-432a-9b0a-8c732150a707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:27.012341 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09a83a-0180-432a-9b0a-8c732150a707 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:27.023411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 539/1063] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:26 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:29.599475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f878-207f-44d4-a31e-5f9613ba8ffc None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:29.600094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f878-207f-44d4-a31e-5f9613ba8ffc None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:29.600094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d5f878-207f-44d4-a31e-5f9613ba8ffc None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:29.601464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 525/1064] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:29 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:29.607318 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb829e-e9bb-4a2a-9e2c-64b0c79b1e39 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:29.607874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb829e-e9bb-4a2a-9e2c-64b0c79b1e39 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:29.607874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fb829e-e9bb-4a2a-9e2c-64b0c79b1e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:29.628938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-13fb829e-e9bb-4a2a-9e2c-64b0c79b1e39 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:29.630179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-13fb829e-e9bb-4a2a-9e2c-64b0c79b1e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:29.639134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 540/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:29 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:29.679877 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5f878-207f-44d4-a31e-5f9613ba8ffc None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:29.691628 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d5f878-207f-44d4-a31e-5f9613ba8ffc None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:29.695705 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0b0061-208c-4d21-b8ec-cbf74591ea0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:29.696350 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b0061-208c-4d21-b8ec-cbf74591ea0b service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:29.696634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b0061-208c-4d21-b8ec-cbf74591ea0b service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:29.696912 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0b0061-208c-4d21-b8ec-cbf74591ea0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:29.707479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b0061-208c-4d21-b8ec-cbf74591ea0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:29.708942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0b0061-208c-4d21-b8ec-cbf74591ea0b service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:29.718929 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 526/1066] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:29 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:32.058018 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a848d-710f-4db2-9824-d9d9f8a38b13 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:32.058585 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a848d-710f-4db2-9824-d9d9f8a38b13 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:32.058585 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a848d-710f-4db2-9824-d9d9f8a38b13 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:32.060002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 541/1067] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:32.066826 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237269b-8e8b-4344-b6d6-6ffa3b7a84a7 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:32.067259 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237269b-8e8b-4344-b6d6-6ffa3b7a84a7 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:32.067408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237269b-8e8b-4344-b6d6-6ffa3b7a84a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:32.087626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f237269b-8e8b-4344-b6d6-6ffa3b7a84a7 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:32.088889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f237269b-8e8b-4344-b6d6-6ffa3b7a84a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:32.096955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 527/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:32 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:32.137247 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a848d-710f-4db2-9824-d9d9f8a38b13 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:32.149885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a848d-710f-4db2-9824-d9d9f8a38b13 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:32.153975 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c807933-6aae-4c7b-96e1-596d470ed875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:32.154614 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807933-6aae-4c7b-96e1-596d470ed875 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:32.154895 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807933-6aae-4c7b-96e1-596d470ed875 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:32.155172 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c807933-6aae-4c7b-96e1-596d470ed875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:32.164988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807933-6aae-4c7b-96e1-596d470ed875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:32.166461 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c807933-6aae-4c7b-96e1-596d470ed875 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:32.175979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 542/1069] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:32 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:34.513063 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4352dd-de14-4ca6-8c8e-4da52722b27a None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:34.513641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4352dd-de14-4ca6-8c8e-4da52722b27a None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:34.513641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4352dd-de14-4ca6-8c8e-4da52722b27a None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:34.514981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 528/1070] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:34 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:34.520998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390907-6201-4295-8727-d740cd2b5525 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:34.521442 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390907-6201-4295-8727-d740cd2b5525 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:34.521665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d390907-6201-4295-8727-d740cd2b5525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:34.542124 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-7d390907-6201-4295-8727-d740cd2b5525 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:34.543334 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-7d390907-6201-4295-8727-d740cd2b5525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:34.552236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 543/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:34 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:34.592253 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4352dd-de14-4ca6-8c8e-4da52722b27a None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:34.605103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4352dd-de14-4ca6-8c8e-4da52722b27a None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:34.609622 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d0b21b-7f55-470e-87f8-5b249a270dc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:34.610264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b21b-7f55-470e-87f8-5b249a270dc0 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:34.610544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b21b-7f55-470e-87f8-5b249a270dc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:34.610821 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d0b21b-7f55-470e-87f8-5b249a270dc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:34.621023 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b21b-7f55-470e-87f8-5b249a270dc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:34.622463 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d0b21b-7f55-470e-87f8-5b249a270dc0 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:34.632257 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 529/1072] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:34 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:37.057162 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89563-11f6-4425-ad9f-c6662ee13dd0 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:37.057708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89563-11f6-4425-ad9f-c6662ee13dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:37.057708 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e89563-11f6-4425-ad9f-c6662ee13dd0 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:37.059115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 544/1073] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:37 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:37.064743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd3f0a-7aa2-46ac-aba8-be337701d317 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:37.065231 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd3f0a-7aa2-46ac-aba8-be337701d317 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:37.065334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dd3f0a-7aa2-46ac-aba8-be337701d317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:37.073501 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=70 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:37.087849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a4dd3f0a-7aa2-46ac-aba8-be337701d317 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:37.089006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a4dd3f0a-7aa2-46ac-aba8-be337701d317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:37.097072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 530/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:37 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:37.137479 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89563-11f6-4425-ad9f-c6662ee13dd0 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:37.144972 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=64 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:37.152819 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e89563-11f6-4425-ad9f-c6662ee13dd0 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:37.156599 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602b84fd-68cf-49c0-b65c-d8de79aadcae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:37.157238 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b84fd-68cf-49c0-b65c-d8de79aadcae service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:37.157518 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b84fd-68cf-49c0-b65c-d8de79aadcae service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:37.157773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602b84fd-68cf-49c0-b65c-d8de79aadcae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:37.167469 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b84fd-68cf-49c0-b65c-d8de79aadcae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:37.168923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602b84fd-68cf-49c0-b65c-d8de79aadcae service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:37.178212 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 545/1075] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:37 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:12:39.442459 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67425d-6c92-4504-a672-4fbe5400af62 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:39.443039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67425d-6c92-4504-a672-4fbe5400af62 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:39.443039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab67425d-6c92-4504-a672-4fbe5400af62 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:39.444455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 531/1076] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:39 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:39.450038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e62803-54df-4dc5-a751-446768ad9335 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:39.450495 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e62803-54df-4dc5-a751-446768ad9335 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:39.450622 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e62803-54df-4dc5-a751-446768ad9335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:39.473507 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-e8e62803-54df-4dc5-a751-446768ad9335 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:39.474727 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-e8e62803-54df-4dc5-a751-446768ad9335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:39.483342 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 546/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:39 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:39.525203 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67425d-6c92-4504-a672-4fbe5400af62 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:39.537781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab67425d-6c92-4504-a672-4fbe5400af62 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:39.541933 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc18745-b91d-4f83-a12e-fb2a54540cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:39.542586 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc18745-b91d-4f83-a12e-fb2a54540cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:39.542868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc18745-b91d-4f83-a12e-fb2a54540cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:39.543141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc18745-b91d-4f83-a12e-fb2a54540cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:39.553071 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc18745-b91d-4f83-a12e-fb2a54540cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:39.554580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc18745-b91d-4f83-a12e-fb2a54540cb8 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:39.564600 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 532/1078] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:41.821685 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9380b0a-c22a-42cb-847e-cafb5b2d0f61 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:41.823863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9380b0a-c22a-42cb-847e-cafb5b2d0f61 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:41.823863 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9380b0a-c22a-42cb-847e-cafb5b2d0f61 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:41.827254 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 547/1079] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:41 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:41.832343 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd2ca-a12d-4ca4-ba78-3383590f866c None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:41.832998 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd2ca-a12d-4ca4-ba78-3383590f866c None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:41.833144 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995bd2ca-a12d-4ca4-ba78-3383590f866c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:41.855076 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-995bd2ca-a12d-4ca4-ba78-3383590f866c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:41.856295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-995bd2ca-a12d-4ca4-ba78-3383590f866c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:41.865978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 533/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:41 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:41.914751 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9380b0a-c22a-42cb-847e-cafb5b2d0f61 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:41.927832 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9380b0a-c22a-42cb-847e-cafb5b2d0f61 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:41.932248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28cea2-6a9b-46c5-aad3-385b7ec7be61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:41.932902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28cea2-6a9b-46c5-aad3-385b7ec7be61 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:41.933185 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28cea2-6a9b-46c5-aad3-385b7ec7be61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:41.933491 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28cea2-6a9b-46c5-aad3-385b7ec7be61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:41.944957 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28cea2-6a9b-46c5-aad3-385b7ec7be61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:41.947139 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28cea2-6a9b-46c5-aad3-385b7ec7be61 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:41.959061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 548/1081] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:41 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:44.185515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8c160-a78a-4e95-9c93-2b8c293906af None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:44.186087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8c160-a78a-4e95-9c93-2b8c293906af None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:44.186087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de8c160-a78a-4e95-9c93-2b8c293906af None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:44.187348 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 534/1082] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:44.193048 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be447f-bd65-4f8a-95cf-7474da2faf1e None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:44.193519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be447f-bd65-4f8a-95cf-7474da2faf1e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:44.193622 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be447f-bd65-4f8a-95cf-7474da2faf1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:44.213899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-b3be447f-bd65-4f8a-95cf-7474da2faf1e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:44.215101 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-b3be447f-bd65-4f8a-95cf-7474da2faf1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:44.224371 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 549/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:44 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:44.270654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8c160-a78a-4e95-9c93-2b8c293906af None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:44.283689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de8c160-a78a-4e95-9c93-2b8c293906af None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:44.288825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dfb068-9560-45bf-8574-f71d76aebf4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:44.289481 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb068-9560-45bf-8574-f71d76aebf4f service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:44.289787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb068-9560-45bf-8574-f71d76aebf4f service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:44.290089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dfb068-9560-45bf-8574-f71d76aebf4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:44.300969 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb068-9560-45bf-8574-f71d76aebf4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:44.302449 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dfb068-9560-45bf-8574-f71d76aebf4f service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:44.313080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 535/1084] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:44 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:46.678505 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6636c-5986-42e8-ae11-533352660c88 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:46.679074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6636c-5986-42e8-ae11-533352660c88 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:46.679074 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b6636c-5986-42e8-ae11-533352660c88 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:46.680892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 550/1085] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:12:46 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:12:46.687255 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b2c3a-8678-443f-83e3-df4a550a1030 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:46.687785 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b2c3a-8678-443f-83e3-df4a550a1030 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:46.687887 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b2c3a-8678-443f-83e3-df4a550a1030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:46.708260 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f58b2c3a-8678-443f-83e3-df4a550a1030 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:12:46.709465 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f58b2c3a-8678-443f-83e3-df4a550a1030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:12:46.717548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 536/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:12:46 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:12:46.756902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6636c-5986-42e8-ae11-533352660c88 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:12:46.773754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b6636c-5986-42e8-ae11-533352660c88 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:12:46.779256 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f5ba0d-cde9-42ad-95f5-18e9c02b7350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:12:46.780095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5ba0d-cde9-42ad-95f5-18e9c02b7350 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:12:46.780436 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5ba0d-cde9-42ad-95f5-18e9c02b7350 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:12:46.780815 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5ba0d-cde9-42ad-95f5-18e9c02b7350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:12:46.794432 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5ba0d-cde9-42ad-95f5-18e9c02b7350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:12:46.795899 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f5ba0d-cde9-42ad-95f5-18e9c02b7350 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:12:46.806466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 551/1087] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:12:46 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:12:56.703013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=20 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:12:56.801674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=23 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:10.677197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37a82-74a1-4394-a3f2-c5bc294f9871 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:10.677791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37a82-74a1-4394-a3f2-c5bc294f9871 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:10.677791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b37a82-74a1-4394-a3f2-c5bc294f9871 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:10.679162 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 537/1088] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:10 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:10.685054 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fac82-c6fe-4b30-acd1-5c67abaab410 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:10.685596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fac82-c6fe-4b30-acd1-5c67abaab410 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:10.685596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06fac82-c6fe-4b30-acd1-5c67abaab410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:10.707089 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-d06fac82-c6fe-4b30-acd1-5c67abaab410 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:10.708323 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d06fac82-c6fe-4b30-acd1-5c67abaab410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:10.717954 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 552/1089] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:10 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:10.779350 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb795-5c64-48cb-9e62-4be0fbc5e16e None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:10.779829 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb795-5c64-48cb-9e62-4be0fbc5e16e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:10.780254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb795-5c64-48cb-9e62-4be0fbc5e16e None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:10.782393 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 538/1090] 10.222.0.112 () {54 vars in 971 bytes} [Mon Jul 25 19:13:10 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:13:10.790527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c63a9-4f58-469c-97f7-7ab1d5461aea None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:10.790783 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c63a9-4f58-469c-97f7-7ab1d5461aea None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:10.791261 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c63a9-4f58-469c-97f7-7ab1d5461aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:10.819090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-601c63a9-4f58-469c-97f7-7ab1d5461aea None None] MFA Rules not processed for user `fbb8bab39c68414b8db430d75072f892`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:10.820316 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-601c63a9-4f58-469c-97f7-7ab1d5461aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:10.827841 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 553/1091] 10.222.0.112 () {58 vars in 1068 bytes} [Mon Jul 25 19:13:10 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:10.835594 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb795-5c64-48cb-9e62-4be0fbc5e16e None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:10.847668 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb795-5c64-48cb-9e62-4be0fbc5e16e None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:10.851492 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986bb926-8684-4acd-94fe-8b00deda41e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbb8bab39c68414b8db430d75072f892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:10.852127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bb926-8684-4acd-94fe-8b00deda41e9 service glance] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:10.852408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bb926-8684-4acd-94fe-8b00deda41e9 service glance] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:10.852680 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986bb926-8684-4acd-94fe-8b00deda41e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:10.862631 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bb926-8684-4acd-94fe-8b00deda41e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:10.864146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986bb926-8684-4acd-94fe-8b00deda41e9 service glance] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:10.873503 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 539/1092] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:10 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:13.192228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b1373-0c4e-4ad7-9b49-f24fb56aae79 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:13.192871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b1373-0c4e-4ad7-9b49-f24fb56aae79 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:13.192871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b1373-0c4e-4ad7-9b49-f24fb56aae79 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:13.194135 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 554/1093] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:13 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:13.199810 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff6724-88f4-4d89-a42a-68801140dd55 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:13.200338 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff6724-88f4-4d89-a42a-68801140dd55 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:13.200338 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feff6724-88f4-4d89-a42a-68801140dd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:13.220242 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-feff6724-88f4-4d89-a42a-68801140dd55 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:13.221430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-feff6724-88f4-4d89-a42a-68801140dd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:13.229953 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 540/1094] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:13 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:13.255092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b1373-0c4e-4ad7-9b49-f24fb56aae79 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:13.269443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b1373-0c4e-4ad7-9b49-f24fb56aae79 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:13.274794 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:13.275501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:13.275787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:13.276064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:13.276817 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:13.278611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:13:13.278611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:13:13.278611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:13:13.279822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b2d7a-82e1-4ac4-8dba-7daa88e107c5 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:13.299561 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 555/1095] 10.222.0.112 () {56 vars in 1113 bytes} [Mon Jul 25 19:13:13 2022] GET /identity/v3/projects => generated 1612 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:13:15.543095 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aae4f5-6141-4cd9-a8f5-abc76bb3d627 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:15.543733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aae4f5-6141-4cd9-a8f5-abc76bb3d627 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:15.543733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aae4f5-6141-4cd9-a8f5-abc76bb3d627 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:15.545446 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 541/1096] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:15 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:15.551235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f79c1-c094-47d0-af75-71ece5b1220c None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:15.551822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f79c1-c094-47d0-af75-71ece5b1220c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:15.551822 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f79c1-c094-47d0-af75-71ece5b1220c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:15.573711 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-572f79c1-c094-47d0-af75-71ece5b1220c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:15.574915 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-572f79c1-c094-47d0-af75-71ece5b1220c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:15.583542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 556/1097] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:15 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:15.631984 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aae4f5-6141-4cd9-a8f5-abc76bb3d627 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:15.655104 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aae4f5-6141-4cd9-a8f5-abc76bb3d627 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:15.663787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d49fb2-d335-4e78-99da-d1396313ed37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:15.664851 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49fb2-d335-4e78-99da-d1396313ed37 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:15.665324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49fb2-d335-4e78-99da-d1396313ed37 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:15.665796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49fb2-d335-4e78-99da-d1396313ed37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:15.679590 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d49fb2-d335-4e78-99da-d1396313ed37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:15.681192 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d49fb2-d335-4e78-99da-d1396313ed37 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:15.690961 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 542/1098] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:15 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:18.129028 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78288c09-05b1-430b-94aa-4e9c314514da None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:18.129949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78288c09-05b1-430b-94aa-4e9c314514da None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:18.129949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78288c09-05b1-430b-94aa-4e9c314514da None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:18.132062 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 557/1099] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:18 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:18.140652 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59efa3-b28e-435d-a6b7-a891319fd98b None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:18.141083 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59efa3-b28e-435d-a6b7-a891319fd98b None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:18.141236 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59efa3-b28e-435d-a6b7-a891319fd98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:18.167860 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-3b59efa3-b28e-435d-a6b7-a891319fd98b None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:18.169082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-3b59efa3-b28e-435d-a6b7-a891319fd98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:18.178963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 543/1100] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:18 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:18.219834 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78288c09-05b1-430b-94aa-4e9c314514da None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:18.233549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78288c09-05b1-430b-94aa-4e9c314514da None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:18.237399 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8d106-7f4b-4ed9-84dd-873fc4fba671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:18.238072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d106-7f4b-4ed9-84dd-873fc4fba671 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:18.238359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d106-7f4b-4ed9-84dd-873fc4fba671 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:18.238641 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8d106-7f4b-4ed9-84dd-873fc4fba671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:18.248160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d106-7f4b-4ed9-84dd-873fc4fba671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:18.249770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8d106-7f4b-4ed9-84dd-873fc4fba671 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:18.260377 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 558/1101] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:18 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:20.564903 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6df1f9-5d0c-45ce-835a-b12405968e36 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:20.565477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6df1f9-5d0c-45ce-835a-b12405968e36 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:20.565715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6df1f9-5d0c-45ce-835a-b12405968e36 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:20.567467 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 544/1102] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:20 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:20.573669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994cf44-e7a4-411a-bf90-068b8041fa2e None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:20.574218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994cf44-e7a4-411a-bf90-068b8041fa2e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:20.574218 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994cf44-e7a4-411a-bf90-068b8041fa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:20.594787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-e994cf44-e7a4-411a-bf90-068b8041fa2e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:20.596267 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-e994cf44-e7a4-411a-bf90-068b8041fa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:20.605132 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 559/1103] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:20 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:20.651421 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6df1f9-5d0c-45ce-835a-b12405968e36 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:20.673324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6df1f9-5d0c-45ce-835a-b12405968e36 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:20.678651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e6e1fb-0b64-4ba3-acd8-8ea629eb56de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:20.679784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6e1fb-0b64-4ba3-acd8-8ea629eb56de service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:20.680255 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6e1fb-0b64-4ba3-acd8-8ea629eb56de service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:20.680681 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e6e1fb-0b64-4ba3-acd8-8ea629eb56de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:20.691514 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6e1fb-0b64-4ba3-acd8-8ea629eb56de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:20.693055 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e6e1fb-0b64-4ba3-acd8-8ea629eb56de service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:20.702691 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 545/1104] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:20 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:23.132742 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff22933-5467-420c-8143-f8f36b9ffefd None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:23.133567 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff22933-5467-420c-8143-f8f36b9ffefd None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:23.133567 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff22933-5467-420c-8143-f8f36b9ffefd None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:23.135785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 560/1105] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:23 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:13:23.141195 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b041-6c3e-4177-8b92-e933b62aace6 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:23.141690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b041-6c3e-4177-8b92-e933b62aace6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:23.141791 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7b041-6c3e-4177-8b92-e933b62aace6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:23.162873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-13d7b041-6c3e-4177-8b92-e933b62aace6 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:23.164103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-13d7b041-6c3e-4177-8b92-e933b62aace6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:23.172962 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 546/1106] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:23 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:23.217492 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff22933-5467-420c-8143-f8f36b9ffefd None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:23.230909 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff22933-5467-420c-8143-f8f36b9ffefd None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:23.235383 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609931d-f382-4f23-acfa-c5a6404b2dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:23.236022 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609931d-f382-4f23-acfa-c5a6404b2dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:23.236434 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609931d-f382-4f23-acfa-c5a6404b2dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:23.236746 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609931d-f382-4f23-acfa-c5a6404b2dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:23.247065 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609931d-f382-4f23-acfa-c5a6404b2dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:23.249095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609931d-f382-4f23-acfa-c5a6404b2dc5 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:23.264388 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 561/1107] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:23 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:25.726067 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a92a2-c524-4a4f-b499-f80d9d0f01df None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:25.726652 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a92a2-c524-4a4f-b499-f80d9d0f01df None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:25.726652 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a92a2-c524-4a4f-b499-f80d9d0f01df None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:25.728011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 547/1108] 10.222.0.112 () {54 vars in 931 bytes} [Mon Jul 25 19:13:25 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:13:25.733644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff737-6239-4dfe-8c7d-d1e255a378c1 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:25.734106 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff737-6239-4dfe-8c7d-d1e255a378c1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:25.734222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7ff737-6239-4dfe-8c7d-d1e255a378c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:25.755871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-fe7ff737-6239-4dfe-8c7d-d1e255a378c1 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:13:25.757023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-fe7ff737-6239-4dfe-8c7d-d1e255a378c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:13:25.766346 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 562/1109] 10.222.0.112 () {58 vars in 1028 bytes} [Mon Jul 25 19:13:25 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:13:25.808367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a92a2-c524-4a4f-b499-f80d9d0f01df None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:13:25.819808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a92a2-c524-4a4f-b499-f80d9d0f01df None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:13:25.823715 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bada862-b010-4f11-b49f-8ac557ceba5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:13:25.824267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada862-b010-4f11-b49f-8ac557ceba5e service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:13:25.824548 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada862-b010-4f11-b49f-8ac557ceba5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:13:25.824817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bada862-b010-4f11-b49f-8ac557ceba5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:13:25.834079 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bada862-b010-4f11-b49f-8ac557ceba5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:13:25.835541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bada862-b010-4f11-b49f-8ac557ceba5e service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:13:25.847142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 548/1110] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:13:25 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:13:35.748966 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=33 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:13:35.841407 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=33 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:57.260516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.261521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.261521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.287113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:57.288376 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:57.297215 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 563/1111] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:14:57 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:14:57.306676 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.307367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.307367 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.336692 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:57.338564 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:57.350470 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 549/1112] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:14:57 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:14:57.356759 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.372080 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef6fa5-6c5b-46ed-81b8-e17c0a9fff2c None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.379803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.380600 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.381073 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.381558 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.382809 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:14:57.383314 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.384381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:57.384381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:14:57.384381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:14:57.385279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:57.400903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 564/1113] 10.222.0.112 () {58 vars in 1158 bytes} [Mon Jul 25 19:14:57 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:14:57.409513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.421013 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbf91a3-ec87-440e-9da1-afbc00655162 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.427244 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.427918 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.428200 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.428477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.429168 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.431220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:57.431220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:14:57.431220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:14:57.432461 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:57.467551 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 550/1114] 10.222.0.112 () {60 vars in 1158 bytes} [Mon Jul 25 19:14:57 2022] POST /identity/v3/projects => generated 380 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:14:57.473830 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.484593 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa6dc7-37ee-4741-911a-9366efe4addb admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.554700 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.555378 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.555696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.555961 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.556654 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.557674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:57.557674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:14:57.557674 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:14:57.558843 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:57.587547 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 565/1115] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:14:57 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:14:57.592309 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.607565 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fac9f6-18ee-4043-b291-0173f9d52c5a admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.612479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.613119 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.613514 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.613784 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.614544 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.615529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:57.615529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:14:57.615529 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:14:57.616417 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:57.630149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 551/1116] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:14:57 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:14:57.634739 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.645381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1457c-0ed5-4bbb-a1ee-494c5307b83a admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.652199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.653034 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.653389 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.653786 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.654630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.655780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:57.655780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:14:57.655780 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:14:57.656907 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f01811f-d447-4873-b056-4bbfcf26aa27 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:57.672943 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 566/1117] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:14:57 2022] GET /identity/v3/roles => generated 1427 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:14:57.677451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.687636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80af8155-84f1-4605-a4e6-8b8efe4415d9 admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.692734 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.693732 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.694053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.694366 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] PATH_INFO: `/v3/projects/66c0e38c68e840bdacc488d24e97b8a2/users/c13e5ddf5ea34d008e12a706c8469365/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.710141 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c0e38c68e840bdacc488d24e97b8a2, user_id=c13e5ddf5ea34d008e12a706c8469365, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.711197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:57.711197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:14:57.711197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:14:57.713264 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a98525-e7fa-4aad-8044-fed0dbd3d377 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:57.728493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 552/1118] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:14:57 2022] PUT /identity/v3/projects/66c0e38c68e840bdacc488d24e97b8a2/users/c13e5ddf5ea34d008e12a706c8469365/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:14:57.741321 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ef0f-3efb-4dc4-aa6c-45d8d8cd5041 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.741617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ef0f-3efb-4dc4-aa6c-45d8d8cd5041 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.741934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0726ef0f-3efb-4dc4-aa6c-45d8d8cd5041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.771760 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-0726ef0f-3efb-4dc4-aa6c-45d8d8cd5041 None None] MFA Rules not processed for user `c13e5ddf5ea34d008e12a706c8469365`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:57.772965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-0726ef0f-3efb-4dc4-aa6c-45d8d8cd5041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:57.840746 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 567/1119] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:14:57 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:14:57.858739 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfecbf2-83e7-43ba-a585-532fc933a212 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.859039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfecbf2-83e7-43ba-a585-532fc933a212 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.859331 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfecbf2-83e7-43ba-a585-532fc933a212 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.860763 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 553/1120] 10.222.0.112 () {54 vars in 969 bytes} [Mon Jul 25 19:14:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:14:57.867787 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746897-72e1-4c98-b44a-174cd6486aae None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.868276 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746897-72e1-4c98-b44a-174cd6486aae None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.868754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40746897-72e1-4c98-b44a-174cd6486aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.892127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-40746897-72e1-4c98-b44a-174cd6486aae None None] MFA Rules not processed for user `54ea2fbc34f9488e8a431acf95db792f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:57.893327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-40746897-72e1-4c98-b44a-174cd6486aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:57.946950 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:57.956092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 568/1121] 10.222.0.112 () {58 vars in 1066 bytes} [Mon Jul 25 19:14:57 2022] POST /identity/v3/auth/tokens => generated 2678 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:14:57.963905 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfecbf2-83e7-43ba-a585-532fc933a212 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:57.975475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfecbf2-83e7-43ba-a585-532fc933a212 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:57.979134 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54ea2fbc34f9488e8a431acf95db792f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:57.979815 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:57.980093 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:57.980368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:57.989423 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:57.990871 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:58.002025 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 554/1122] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:14:57 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:58.045663 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ec05-ad59-4c0d-b7c8-5ccfb25cec76 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.045950 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ec05-ad59-4c0d-b7c8-5ccfb25cec76 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.046227 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720ec05-ad59-4c0d-b7c8-5ccfb25cec76 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.047557 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 569/1123] 10.222.0.112 () {52 vars in 835 bytes} [Mon Jul 25 19:14:58 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:14:58.051114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:58.129408 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f10d5-6a84-44ea-a791-09ed567c3ce7 service cinder] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:58.134136 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:58.135122 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.135456 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.135741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] PATH_INFO: `/v3/users/c13e5ddf5ea34d008e12a706c8469365` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.136988 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=c13e5ddf5ea34d008e12a706c8469365)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:58.138112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:58.138112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:14:58.138112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:14:58.139719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:58.215091 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c13e5ddf5ea34d008e12a706c8469365'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:58.226567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c13e5ddf5ea34d008e12a706c8469365'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:58.242606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c13e5ddf5ea34d008e12a706c8469365'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:58.268050 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c13e5ddf5ea34d008e12a706c8469365'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:58.269037 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c13e5ddf5ea34d008e12a706c8469365'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:58.275889 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 555/1124] 10.222.0.112 () {58 vars in 1229 bytes} [Mon Jul 25 19:14:58 2022] DELETE /identity/v3/users/c13e5ddf5ea34d008e12a706c8469365 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:14:58.281290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.282064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.282064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.303188 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:14:58.304430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:58.369777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 570/1125] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:14:58 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:14:58.382102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:58.383654 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:58.389808 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:14:58.451909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ea819-edb3-458d-96c2-65294d9fd6ba admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:58.455938 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76a4d5-bd23-49bd-8424-4e3f122184b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:58.456663 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a4d5-bd23-49bd-8424-4e3f122184b4 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.456937 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a4d5-bd23-49bd-8424-4e3f122184b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.457222 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76a4d5-bd23-49bd-8424-4e3f122184b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.467639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76a4d5-bd23-49bd-8424-4e3f122184b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:58.469112 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76a4d5-bd23-49bd-8424-4e3f122184b4 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:58.479300 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 556/1126] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:14:58 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:14:58.894948 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:14:58.897542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:14:58.911023 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76128774-7793-4b04-9dca-a0a961afd7a9 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:14:58.916644 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:14:58.917551 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:14:58.917825 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:14:58.918114 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] PATH_INFO: `/v3/projects/66c0e38c68e840bdacc488d24e97b8a2` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:14:58.919554 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c0e38c68e840bdacc488d24e97b8a2)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:14:58.921072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:14:58.921072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:14:58.921072 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:14:58.922696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:14:59.002484 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c0e38c68e840bdacc488d24e97b8a2', 'request_id': 'req-a4723ebd-6208-46c9-b5df-150a8f340b27'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:59.008871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c0e38c68e840bdacc488d24e97b8a2', 'request_id': 'req-a4723ebd-6208-46c9-b5df-150a8f340b27'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:59.018746 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c0e38c68e840bdacc488d24e97b8a2', 'request_id': 'req-a4723ebd-6208-46c9-b5df-150a8f340b27'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:59.040056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] The token cache is being invalidate because project 66c0e38c68e840bdacc488d24e97b8a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:14:59.040340 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:59.041179 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-a4723ebd-6208-46c9-b5df-150a8f340b27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:14:59.042785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 571/1127] 10.222.0.112 () {58 vars in 1238 bytes} [Mon Jul 25 19:14:58 2022] DELETE /identity/v3/projects/66c0e38c68e840bdacc488d24e97b8a2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:15:08.474613 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=25 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:15:09.036775 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:31.566589 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916095e-e2ac-4ea5-8c98-3f48e04951c2 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:31.567499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916095e-e2ac-4ea5-8c98-3f48e04951c2 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:31.567499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3916095e-e2ac-4ea5-8c98-3f48e04951c2 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:31.568877 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 557/1128] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:16:31 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:31.574525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268854e6-cb49-47fc-8fa4-4b8c7a1748d2 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:31.575038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268854e6-cb49-47fc-8fa4-4b8c7a1748d2 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:31.575038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268854e6-cb49-47fc-8fa4-4b8c7a1748d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:31.655092 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-268854e6-cb49-47fc-8fa4-4b8c7a1748d2 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:31.656469 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-268854e6-cb49-47fc-8fa4-4b8c7a1748d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:31.760873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 572/1129] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:16:31 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:31.921567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916095e-e2ac-4ea5-8c98-3f48e04951c2 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:31.924470 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-3916095e-e2ac-4ea5-8c98-3f48e04951c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:32.030304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3916095e-e2ac-4ea5-8c98-3f48e04951c2 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:32.036386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884febba-1f3e-4aea-a4b8-c3180d9c2d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:32.037043 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884febba-1f3e-4aea-a4b8-c3180d9c2d9f service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:32.037329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884febba-1f3e-4aea-a4b8-c3180d9c2d9f service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:32.037605 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884febba-1f3e-4aea-a4b8-c3180d9c2d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:32.046402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884febba-1f3e-4aea-a4b8-c3180d9c2d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:32.048346 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884febba-1f3e-4aea-a4b8-c3180d9c2d9f service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:32.062858 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 558/1130] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:31 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:32.932416 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d79651-efc5-4e31-b760-dd748019c796 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:32.933034 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d79651-efc5-4e31-b760-dd748019c796 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:32.933034 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d79651-efc5-4e31-b760-dd748019c796 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:32.934386 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 573/1131] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:16:32 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:32.940306 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74795-6b2e-475d-a0d3-b898a205a45e None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:32.940814 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74795-6b2e-475d-a0d3-b898a205a45e None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:32.940978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74795-6b2e-475d-a0d3-b898a205a45e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:32.976200 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c0e74795-6b2e-475d-a0d3-b898a205a45e None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:32.977443 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c0e74795-6b2e-475d-a0d3-b898a205a45e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:32.986861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 559/1132] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:16:32 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:33.143634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d79651-efc5-4e31-b760-dd748019c796 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:33.158618 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d79651-efc5-4e31-b760-dd748019c796 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:33.164009 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ec5c1-ee4d-447d-a2ba-ad06a7dd7520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:33.164661 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec5c1-ee4d-447d-a2ba-ad06a7dd7520 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:33.164944 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec5c1-ee4d-447d-a2ba-ad06a7dd7520 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:33.165221 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ec5c1-ee4d-447d-a2ba-ad06a7dd7520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:33.174717 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec5c1-ee4d-447d-a2ba-ad06a7dd7520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:33.176411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ec5c1-ee4d-447d-a2ba-ad06a7dd7520 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:33.187017 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 574/1133] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:33 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:38.355206 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575276-9d9e-486f-8b5c-ce3b6cadefa8 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:38.355891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575276-9d9e-486f-8b5c-ce3b6cadefa8 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:38.355891 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7575276-9d9e-486f-8b5c-ce3b6cadefa8 None None] PATH_INFO: `/v3` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:38.357442 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 560/1134] 10.222.0.121 () {54 vars in 930 bytes} [Mon Jul 25 19:16:38 2022] GET /identity/v3 => generated 256 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:16:38.365938 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248a22a-0068-471e-abf7-e0844a3a2481 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:38.366465 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248a22a-0068-471e-abf7-e0844a3a2481 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:38.366465 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248a22a-0068-471e-abf7-e0844a3a2481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:38.402321 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-0248a22a-0068-471e-abf7-e0844a3a2481 None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:38.403575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-0248a22a-0068-471e-abf7-e0844a3a2481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:38.459985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=100 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:38.470701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 575/1135] 10.222.0.121 () {58 vars in 1020 bytes} [Mon Jul 25 19:16:38 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:42.970515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=42 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:16:44.494238 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e219d-4e15-4d6a-a6a7-3682537b8ef6 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:44.494980 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e219d-4e15-4d6a-a6a7-3682537b8ef6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:44.494980 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e219d-4e15-4d6a-a6a7-3682537b8ef6 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:44.496238 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 561/1136] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:16:44 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:44.501935 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d484-1dac-49e3-bc16-32ca90ae21e1 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:44.502458 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d484-1dac-49e3-bc16-32ca90ae21e1 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:44.502458 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38d484-1dac-49e3-bc16-32ca90ae21e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:44.534723 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-fe38d484-1dac-49e3-bc16-32ca90ae21e1 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:44.536412 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-fe38d484-1dac-49e3-bc16-32ca90ae21e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:44.546044 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 576/1137] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:16:44 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:44.712142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e219d-4e15-4d6a-a6a7-3682537b8ef6 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:44.728035 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45e219d-4e15-4d6a-a6a7-3682537b8ef6 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:44.733453 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46848870-6888-49f9-ad1d-e4229bd9fdba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:44.734140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46848870-6888-49f9-ad1d-e4229bd9fdba service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:44.734422 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46848870-6888-49f9-ad1d-e4229bd9fdba service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:44.734703 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46848870-6888-49f9-ad1d-e4229bd9fdba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:44.744711 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46848870-6888-49f9-ad1d-e4229bd9fdba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:44.746371 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46848870-6888-49f9-ad1d-e4229bd9fdba service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:44.757452 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 562/1138] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:44 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:16:45.634852 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e05130-ce37-4c51-882e-2ffbeb5ad13a None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:45.635808 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e05130-ce37-4c51-882e-2ffbeb5ad13a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:45.635985 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e05130-ce37-4c51-882e-2ffbeb5ad13a None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:45.637539 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 577/1139] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:16:45 2022] GET /identity => generated 271 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:45.643688 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8c93-6537-431f-9a97-f200cb171cea None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:45.644295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8c93-6537-431f-9a97-f200cb171cea None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:45.644295 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec8c93-6537-431f-9a97-f200cb171cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:45.665634 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-97ec8c93-6537-431f-9a97-f200cb171cea None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:45.666971 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-97ec8c93-6537-431f-9a97-f200cb171cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:45.675293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 563/1140] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:16:45 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:45.834853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e05130-ce37-4c51-882e-2ffbeb5ad13a None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:45.855893 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e05130-ce37-4c51-882e-2ffbeb5ad13a None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:45.861873 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b46ae2-4f20-4e03-8e89-563ca8947136 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:45.862516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46ae2-4f20-4e03-8e89-563ca8947136 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:45.862796 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46ae2-4f20-4e03-8e89-563ca8947136 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:45.863071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b46ae2-4f20-4e03-8e89-563ca8947136 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:45.872687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b46ae2-4f20-4e03-8e89-563ca8947136 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:45.874288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b46ae2-4f20-4e03-8e89-563ca8947136 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:45.884773 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 578/1141] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:45 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:49.023909 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3f8f-eed1-4ca7-abef-18f1ed057fbd None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:49.024479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3f8f-eed1-4ca7-abef-18f1ed057fbd None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:49.024479 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd3f8f-eed1-4ca7-abef-18f1ed057fbd None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:49.025752 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 564/1142] 10.222.0.112 () {54 vars in 966 bytes} [Mon Jul 25 19:16:49 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:49.031007 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae7ba-3d0e-4c01-bf09-9d74156746ff None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:49.031443 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae7ba-3d0e-4c01-bf09-9d74156746ff None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:49.031630 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ae7ba-3d0e-4c01-bf09-9d74156746ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:49.052302 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-255ae7ba-3d0e-4c01-bf09-9d74156746ff None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:49.053530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-255ae7ba-3d0e-4c01-bf09-9d74156746ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:49.063279 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 579/1143] 10.222.0.112 () {58 vars in 1063 bytes} [Mon Jul 25 19:16:49 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:49.070917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd3f8f-eed1-4ca7-abef-18f1ed057fbd None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:49.086450 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd3f8f-eed1-4ca7-abef-18f1ed057fbd None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:49.092690 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb993dd-d4fb-46b6-9292-5abb63b37905 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:49.093646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb993dd-d4fb-46b6-9292-5abb63b37905 service placement] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:49.093932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb993dd-d4fb-46b6-9292-5abb63b37905 service placement] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:49.094208 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb993dd-d4fb-46b6-9292-5abb63b37905 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:49.105398 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb993dd-d4fb-46b6-9292-5abb63b37905 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:49.107335 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb993dd-d4fb-46b6-9292-5abb63b37905 service placement] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:49.117717 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 565/1144] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:49 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:57.184861 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59a72-a5c3-4f31-a186-0c98a00ad661 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:57.185490 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59a72-a5c3-4f31-a186-0c98a00ad661 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:57.185490 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf59a72-a5c3-4f31-a186-0c98a00ad661 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:57.186797 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 580/1145] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:16:57 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:57.194809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7a36-656b-4fae-bc76-b4a705764e63 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:57.195370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7a36-656b-4fae-bc76-b4a705764e63 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:57.195370 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ce7a36-656b-4fae-bc76-b4a705764e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:57.222413 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-e6ce7a36-656b-4fae-bc76-b4a705764e63 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:57.223684 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-e6ce7a36-656b-4fae-bc76-b4a705764e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:57.232697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 566/1146] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:16:57 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:57.408240 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59a72-a5c3-4f31-a186-0c98a00ad661 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:57.426887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf59a72-a5c3-4f31-a186-0c98a00ad661 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:57.433161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b3623-bbca-4a18-8fab-823126ec013f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:57.433868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3623-bbca-4a18-8fab-823126ec013f service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:57.434144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3623-bbca-4a18-8fab-823126ec013f service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:57.434415 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b3623-bbca-4a18-8fab-823126ec013f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:57.443662 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3623-bbca-4a18-8fab-823126ec013f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:57.445538 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b3623-bbca-4a18-8fab-823126ec013f service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:57.456064 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 581/1147] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:57 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:16:58.289119 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0ba3d-9506-4a50-959c-4a54c53454c1 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:58.290065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0ba3d-9506-4a50-959c-4a54c53454c1 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:58.290065 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b0ba3d-9506-4a50-959c-4a54c53454c1 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:58.292184 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 567/1148] 127.0.0.1 () {54 vars in 901 bytes} [Mon Jul 25 19:16:58 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:16:58.298176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6790c4-2318-49a8-8bfc-d8fa40b24345 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:58.298770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6790c4-2318-49a8-8bfc-d8fa40b24345 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:58.298770 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6790c4-2318-49a8-8bfc-d8fa40b24345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:58.328191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-ff6790c4-2318-49a8-8bfc-d8fa40b24345 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:16:58.329606 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-ff6790c4-2318-49a8-8bfc-d8fa40b24345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:16:58.338801 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 582/1149] 127.0.0.1 () {58 vars in 998 bytes} [Mon Jul 25 19:16:58 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:16:58.508802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0ba3d-9506-4a50-959c-4a54c53454c1 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:16:58.527834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b0ba3d-9506-4a50-959c-4a54c53454c1 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:16:58.533775 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47922612-b683-43b5-b22a-9bf825ce6d6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:16:58.534428 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47922612-b683-43b5-b22a-9bf825ce6d6d service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:16:58.534736 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47922612-b683-43b5-b22a-9bf825ce6d6d service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:16:58.535129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47922612-b683-43b5-b22a-9bf825ce6d6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:16:58.544534 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47922612-b683-43b5-b22a-9bf825ce6d6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:16:58.546054 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47922612-b683-43b5-b22a-9bf825ce6d6d service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:16:58.556664 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 568/1150] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:16:58 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:02.948461 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d3ab-03da-465d-a9b4-15ec3e19d425 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:02.950047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d3ab-03da-465d-a9b4-15ec3e19d425 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:02.950047 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b003d3ab-03da-465d-a9b4-15ec3e19d425 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:02.950872 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 583/1151] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:02 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:02.957840 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5cfe-25a6-46b1-8758-8c2c64b7c691 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:02.958368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5cfe-25a6-46b1-8758-8c2c64b7c691 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:02.958368 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d5cfe-25a6-46b1-8758-8c2c64b7c691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:02.981242 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-9c5d5cfe-25a6-46b1-8758-8c2c64b7c691 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:02.982458 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-9c5d5cfe-25a6-46b1-8758-8c2c64b7c691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:02.995692 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 569/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:02 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:03.033666 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003d3ab-03da-465d-a9b4-15ec3e19d425 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:03.035570 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-b003d3ab-03da-465d-a9b4-15ec3e19d425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:03.120417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b003d3ab-03da-465d-a9b4-15ec3e19d425 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:03.123811 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c9bb74-c40b-4e42-8436-ecbc47d62755 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:03.124489 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9bb74-c40b-4e42-8436-ecbc47d62755 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:03.124772 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9bb74-c40b-4e42-8436-ecbc47d62755 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:03.125051 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c9bb74-c40b-4e42-8436-ecbc47d62755 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:03.136171 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9bb74-c40b-4e42-8436-ecbc47d62755 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:03.137964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c9bb74-c40b-4e42-8436-ecbc47d62755 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:03.147926 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 584/1153] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:03 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:05.560844 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a664264-d1fe-4dd5-aa2b-c8ff52ebc733 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:05.561799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a664264-d1fe-4dd5-aa2b-c8ff52ebc733 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:05.561799 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a664264-d1fe-4dd5-aa2b-c8ff52ebc733 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:05.564369 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 570/1154] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:05 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:05.573500 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ec88-e073-41c2-adfb-b92584f99795 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:05.574257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ec88-e073-41c2-adfb-b92584f99795 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:05.574430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad19ec88-e073-41c2-adfb-b92584f99795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:05.600807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-ad19ec88-e073-41c2-adfb-b92584f99795 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:05.602030 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-ad19ec88-e073-41c2-adfb-b92584f99795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:05.612871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 585/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:05 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:05.653388 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a664264-d1fe-4dd5-aa2b-c8ff52ebc733 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:05.671117 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a664264-d1fe-4dd5-aa2b-c8ff52ebc733 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:05.679133 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248faa5-c96d-47ea-a8ba-72a297a7448b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:05.680454 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248faa5-c96d-47ea-a8ba-72a297a7448b service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:05.680776 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248faa5-c96d-47ea-a8ba-72a297a7448b service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:05.681124 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248faa5-c96d-47ea-a8ba-72a297a7448b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:05.692592 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248faa5-c96d-47ea-a8ba-72a297a7448b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:05.694062 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248faa5-c96d-47ea-a8ba-72a297a7448b service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:05.704543 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 571/1156] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:05 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:09.992552 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ad88c-6073-4f15-b4ea-5a8f0cde1759 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:09.993176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ad88c-6073-4f15-b4ea-5a8f0cde1759 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:09.993176 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ad88c-6073-4f15-b4ea-5a8f0cde1759 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:09.994542 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 586/1157] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:09 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:10.000694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190935-410d-4977-9d70-8067b2c49626 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:10.001294 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190935-410d-4977-9d70-8067b2c49626 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:10.001294 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64190935-410d-4977-9d70-8067b2c49626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:10.025183 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-64190935-410d-4977-9d70-8067b2c49626 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:10.026474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-64190935-410d-4977-9d70-8067b2c49626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:10.034838 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 572/1158] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:09 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:10.312421 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ad88c-6073-4f15-b4ea-5a8f0cde1759 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:10.314860 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-cc7ad88c-6073-4f15-b4ea-5a8f0cde1759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:10.320207 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=56 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:10.389793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ad88c-6073-4f15-b4ea-5a8f0cde1759 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:10.393681 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee6484-3485-4385-93e5-89370bfc63a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54ea2fbc34f9488e8a431acf95db792f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:10.394511 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6484-3485-4385-93e5-89370bfc63a1 service cinder] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:10.394660 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6484-3485-4385-93e5-89370bfc63a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:10.394887 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee6484-3485-4385-93e5-89370bfc63a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:10.406425 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6484-3485-4385-93e5-89370bfc63a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:10.407902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee6484-3485-4385-93e5-89370bfc63a1 service cinder] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:10.418069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 587/1159] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:10 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:12.711006 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2db8-0671-4884-a579-104a5ce7ca3f None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:12.711639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2db8-0671-4884-a579-104a5ce7ca3f None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:12.711639 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca2db8-0671-4884-a579-104a5ce7ca3f None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:12.713130 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 573/1160] 127.0.0.1 () {54 vars in 916 bytes} [Mon Jul 25 19:17:12 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:17:12.718475 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571ef0-408d-4d44-80b9-d1426a500f39 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:12.718928 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571ef0-408d-4d44-80b9-d1426a500f39 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:12.719033 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86571ef0-408d-4d44-80b9-d1426a500f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:12.739281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-86571ef0-408d-4d44-80b9-d1426a500f39 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:17:12.740510 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-86571ef0-408d-4d44-80b9-d1426a500f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:12.749097 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 588/1161] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Jul 25 19:17:12 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:17:13.026477 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2db8-0671-4884-a579-104a5ce7ca3f None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:17:13.028398 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b0ca2db8-0671-4884-a579-104a5ce7ca3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:17:13.036402 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=37 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:13.043258 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca2db8-0671-4884-a579-104a5ce7ca3f None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:17:13.047364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6412e-73d9-4f74-a50c-e4f267ddaa93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54ea2fbc34f9488e8a431acf95db792f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:17:13.048056 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6412e-73d9-4f74-a50c-e4f267ddaa93 service cinder] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:17:13.048361 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6412e-73d9-4f74-a50c-e4f267ddaa93 service cinder] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:17:13.048591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6412e-73d9-4f74-a50c-e4f267ddaa93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:17:13.057964 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6412e-73d9-4f74-a50c-e4f267ddaa93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:17:13.059431 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6412e-73d9-4f74-a50c-e4f267ddaa93 service cinder] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:17:13.070801 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 574/1162] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:17:13 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:17:22.734079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=33 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:17:23.065994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=5 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:38.312749 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395b89-78bc-4889-8f10-ecf767ab352c None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.313493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395b89-78bc-4889-8f10-ecf767ab352c None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.313493 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d395b89-78bc-4889-8f10-ecf767ab352c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.333245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-5d395b89-78bc-4889-8f10-ecf767ab352c None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:38.334430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-5d395b89-78bc-4889-8f10-ecf767ab352c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:38.342668 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 589/1163] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:38.351541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.352213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.352213 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.372316 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:38.373513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:38.379988 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee581be1-1f6e-4600-aa3e-28702ac5706d None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.380308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee581be1-1f6e-4600-aa3e-28702ac5706d None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.380596 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee581be1-1f6e-4600-aa3e-28702ac5706d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.382334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 575/1164] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:38.386771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.395975 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f997c79-da2a-459c-b33d-846afd241001 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.400635 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.400931 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-ee581be1-1f6e-4600-aa3e-28702ac5706d None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:38.401286 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.401567 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.401837 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] PATH_INFO: `/v3/domains` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.402144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-ee581be1-1f6e-4600-aa3e-28702ac5706d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:38.402582 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87474) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:18:38.402884 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.403956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:18:38.403956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:18:38.403956 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:18:38.404837 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.411160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 590/1165] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:18:38.416855 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 576/1166] 10.222.0.112 () {58 vars in 1158 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 25 19:18:38.419517 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.419814 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.420098 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.424527 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.434528 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b333c823-47f7-4987-b5e9-b43a10977336 admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.439697 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.439871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:38.440339 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.440618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.440895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.441066 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:38.441571 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.443474 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.449408 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 591/1167] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:38.454024 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.463536 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5506f0c-56c6-4f3c-922f-3ffaeaf5f437 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.468195 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.468847 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.469127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.469729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] PATH_INFO: `/v3/domains` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.470553 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87475) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 25 19:18:38.470989 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.472923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.481158 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 577/1168] 10.222.0.112 () {60 vars in 1158 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/projects => generated 384 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:18:38.485497 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.497266 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 592/1169] 10.222.0.112 () {58 vars in 1158 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/domains?name=Default => generated 310 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 25 19:18:38.499583 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.511903 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29b0845-7da9-44a8-b7c2-70950d23edda admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.568498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39463a3d-2531-4233-a4bc-0830575517d7 admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.574931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.575657 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.575939 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.576211 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.576955 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.577993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:18:38.577993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:18:38.577993 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:18:38.578957 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.579294 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.579665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.579949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.580231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.580923 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.582003 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:18:38.582003 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:18:38.582003 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:18:38.583184 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.605107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 578/1170] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:18:38.609105 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.619875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7470ecc8-ba5b-498b-b0d5-ac970285c92a admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.621433 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 593/1171] 10.222.0.112 () {60 vars in 1158 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/projects => generated 380 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:18:38.625880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.680079 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.680771 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.681049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.681357 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.682072 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.683751 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.693660 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 579/1172] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/roles => generated 1427 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:18:38.697827 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.707327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1fecf-5cba-43bc-b3c1-df7f93024e05 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.708161 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd5ce1-c962-4b6d-88d5-7fc027c59fca admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.712880 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.713302 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.714242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.714242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.714416 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.714565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.715543 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.715952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.716248 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.716563 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.716974 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.718636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.734324 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 580/1173] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/roles => generated 1427 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:18:38.741127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.750199 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 594/1174] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:18:38.752733 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.755789 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37142-987e-42ff-b2b2-a73e96fdcd6f admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.760831 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe01371-e35a-4dff-8fb9-e568fb8298af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.761822 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01371-e35a-4dff-8fb9-e568fb8298af admin admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.762014 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01371-e35a-4dff-8fb9-e568fb8298af admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.762298 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe01371-e35a-4dff-8fb9-e568fb8298af admin admin] PATH_INFO: `/v3/projects/6d21ffad06ac4d36b7899443db0f92c2/users/a26525fd24a04143bc0642259e281157/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.763085 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38265cc-62cf-4c36-bb6b-ba033a87f05c admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.767761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.768508 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.768754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.768754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.769710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.771344 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.779588 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01371-e35a-4dff-8fb9-e568fb8298af admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d21ffad06ac4d36b7899443db0f92c2, user_id=a26525fd24a04143bc0642259e281157, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.782409 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe01371-e35a-4dff-8fb9-e568fb8298af admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.782999 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 595/1175] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/roles => generated 1427 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:18:38.787969 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.795787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:38.800095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9317c33-7cfc-454f-9a9b-de981cc60497 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.805712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 581/1176] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:18:38 2022] PUT /identity/v3/projects/6d21ffad06ac4d36b7899443db0f92c2/users/a26525fd24a04143bc0642259e281157/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:18:38.807253 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.807578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.807861 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.827102 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:38.828382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:38.836255 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:38.876021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.876701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.876983 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.877257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.877979 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.880057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.894724 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 596/1177] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/roles => generated 1427 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:18:38.896588 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.903964 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 582/1178] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:38.914050 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac33af-667c-486c-917a-c5d54ee27bed admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.915077 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:38.918905 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:38.919853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.920134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.920408 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] PATH_INFO: `/v3/projects/0c5725669659486fb28cc4e53049a867/users/77de8e36db3e42caa1d9a498bc67385f/roles/51992cc8771e4114ab2620b57493b066` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.939037 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c5725669659486fb28cc4e53049a867, user_id=77de8e36db3e42caa1d9a498bc67385f, role_id=51992cc8771e4114ab2620b57493b066)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:38.940127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:18:38.940127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:18:38.940127 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:18:38.942026 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bc59e3-99e5-4a58-89fb-6ca2e6494b2c admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:38.960752 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 597/1179] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:18:38 2022] PUT /identity/v3/projects/0c5725669659486fb28cc4e53049a867/users/77de8e36db3e42caa1d9a498bc67385f/roles/51992cc8771e4114ab2620b57493b066 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 25 19:18:38.965603 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:38.965902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:38.966174 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:38.980077 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6ebbc-6d15-47b7-acfb-9a103cb27f30 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:38.985874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] MFA Rules not processed for user `7930508aa7a648b2940c5e4fcfe5b1be`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:38.987113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:39.031114 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:39.031855 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:39.032143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:39.032419 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:39.053002 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 598/1180] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:38 2022] POST /identity/v3/auth/tokens => generated 2797 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:39.065100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:39.066503 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:39.078464 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85fdbc-7aa3-4ab2-97bb-e076d38d2026 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:39.082134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa081882-8262-4910-a70c-e83fe1087bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:39.082885 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081882-8262-4910-a70c-e83fe1087bab service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:39.083216 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081882-8262-4910-a70c-e83fe1087bab service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:39.083422 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa081882-8262-4910-a70c-e83fe1087bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:39.094161 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081882-8262-4910-a70c-e83fe1087bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:39.095764 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa081882-8262-4910-a70c-e83fe1087bab service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:39.102871 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:39.104470 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:39.109466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 599/1181] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:18:39 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:18:39.115352 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 583/1182] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:18:38 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:18:44.646916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:44.647898 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:44.648325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:44.696430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:44.698040 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:44.792807 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 600/1183] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:44 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:44.797089 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:44.807379 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3447249c-874a-4d2b-a476-68b37ca24175 service neutron] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:44.826604 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:44.827603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:44.828341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:44.829086 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] PATH_INFO: `/v3/projects` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:44.830064 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:44.832334 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:44.839573 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:44.876990 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 584/1184] 10.222.0.112 () {60 vars in 1158 bytes} [Mon Jul 25 19:18:44 2022] POST /identity/v3/projects => generated 380 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:18:44.881648 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:44.905793 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98a285a-e729-4452-9028-f8e0662a6ace None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:44.933228 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:44.989771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:44.990634 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:44.990921 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:44.991196 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] PATH_INFO: `/v3/users` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:44.991934 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:44.994068 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.023740 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 601/1185] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:18:44 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 25 19:18:45.028018 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.047103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9becc4-ab15-47ea-aced-328feb25f21e admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.054028 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc8f90-b23b-4073-b8a5-e3bbf4ca801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.054729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8f90-b23b-4073-b8a5-e3bbf4ca801c admin admin] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.055012 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8f90-b23b-4073-b8a5-e3bbf4ca801c admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.055347 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc8f90-b23b-4073-b8a5-e3bbf4ca801c admin admin] PATH_INFO: `/v3/roles` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.056123 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc8f90-b23b-4073-b8a5-e3bbf4ca801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.057797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc8f90-b23b-4073-b8a5-e3bbf4ca801c admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.127638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 585/1186] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:45 2022] GET /identity/v3/roles => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:18:45.131671 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.144624 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269bbf6-cd5b-493a-a0a9-046c882eb4ee admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.149608 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.150534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.150814 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.151095 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] PATH_INFO: `/v3/projects/a9ca12af7da043a5aff3d5fa9b689978/users/b762813126324c60b5bbbd7f201f4705/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.155039 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.155708 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.156220 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.188889 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ca12af7da043a5aff3d5fa9b689978, user_id=b762813126324c60b5bbbd7f201f4705, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.193452 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.211455 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] MFA Rules not processed for user `a26525fd24a04143bc0642259e281157`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:45.212694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:45.218748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 602/1187] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:18:45 2022] PUT /identity/v3/projects/a9ca12af7da043a5aff3d5fa9b689978/users/b762813126324c60b5bbbd7f201f4705/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:18:45.222883 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.328271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600b3e46-4675-4b7f-bddf-00f4fb032538 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.338281 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.339090 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.341840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.341840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.341840 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.342933 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.358049 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 603/1188] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:45 2022] GET /identity/v3/roles => generated 1427 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:18:45.362826 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.374520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49627ac7-1a0f-42ca-9cea-d10611dc11a1 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.379289 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.380710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] REQUEST_METHOD: `PUT` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.380710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.381051 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] PATH_INFO: `/v3/projects/a9ca12af7da043a5aff3d5fa9b689978/users/b762813126324c60b5bbbd7f201f4705/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.383665 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ca12af7da043a5aff3d5fa9b689978, user_id=b762813126324c60b5bbbd7f201f4705, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.386497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.404167 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 604/1189] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:18:45 2022] PUT /identity/v3/projects/a9ca12af7da043a5aff3d5fa9b689978/users/b762813126324c60b5bbbd7f201f4705/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:18:45.419999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 586/1190] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:45 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:45.425042 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.529943 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacce531-81f8-46b5-bdb6-dc4e6d428a66 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.544514 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.545288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.545578 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.545891 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.546937 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.549298 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.567709 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:45.589056 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 605/1191] 10.222.0.112 () {60 vars in 1158 bytes} [Mon Jul 25 19:18:45 2022] POST /identity/v3/projects => generated 384 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:18:45.592661 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.608424 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031f2f8-22f0-42a3-801d-be9ed7e5ac15 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.718560 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.719420 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.719817 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.720186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] PATH_INFO: `/v3/users` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.721667 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.724389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.777011 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 587/1192] 10.222.0.112 () {60 vars in 1149 bytes} [Mon Jul 25 19:18:45 2022] POST /identity/v3/users => generated 299 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 25 19:18:45.782059 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.806559 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237c74b9-5a62-48ab-9d35-7974c17e32f5 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.813959 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.821142 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.821142 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.821142 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.821142 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.823319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.849143 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 606/1193] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:45 2022] GET /identity/v3/roles => generated 1427 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 25 19:18:45.851498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.881345 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72f26a-b33f-40d8-815e-af7b0f150ebb admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:45.888265 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:45.889917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:45.890272 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:45.890712 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] PATH_INFO: `/v3/projects/1f74f8e1b57746cbbceefb93859cfcbb/users/9a7d815f87ec42fa8238fff4d4de4270/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:45.920341 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f74f8e1b57746cbbceefb93859cfcbb, user_id=9a7d815f87ec42fa8238fff4d4de4270, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:45.924640 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:45.946298 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 588/1194] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:18:45 2022] PUT /identity/v3/projects/1f74f8e1b57746cbbceefb93859cfcbb/users/9a7d815f87ec42fa8238fff4d4de4270/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:18:45.950382 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:45.964728 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c9998-293b-4fdc-8b95-f7268b3a9983 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:46.057403 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962d5d7-60db-4307-a700-42b5b8afa31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:46.058274 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962d5d7-60db-4307-a700-42b5b8afa31f admin admin] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:46.058664 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962d5d7-60db-4307-a700-42b5b8afa31f admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:46.059202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962d5d7-60db-4307-a700-42b5b8afa31f admin admin] PATH_INFO: `/v3/roles` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:46.060134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962d5d7-60db-4307-a700-42b5b8afa31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:46.063067 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962d5d7-60db-4307-a700-42b5b8afa31f admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:46.078519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 607/1195] 10.222.0.112 () {58 vars in 1127 bytes} [Mon Jul 25 19:18:45 2022] GET /identity/v3/roles => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 25 19:18:46.083103 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:46.103670 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31752b34-0932-435f-9b88-b67fe8063434 admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:46.115080 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:46.116171 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] REQUEST_METHOD: `PUT` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:46.116525 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:46.116875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] PATH_INFO: `/v3/projects/1f74f8e1b57746cbbceefb93859cfcbb/users/9a7d815f87ec42fa8238fff4d4de4270/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:46.121912 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f74f8e1b57746cbbceefb93859cfcbb, user_id=9a7d815f87ec42fa8238fff4d4de4270, role_id=39eb0eeb9dd54833ac032b5f6bfe6fe7)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:46.125087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:46.165797 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 589/1196] 10.222.0.112 () {60 vars in 1488 bytes} [Mon Jul 25 19:18:46 2022] PUT /identity/v3/projects/1f74f8e1b57746cbbceefb93859cfcbb/users/9a7d815f87ec42fa8238fff4d4de4270/roles/39eb0eeb9dd54833ac032b5f6bfe6fe7 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:18:52.377449 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0168f70-b684-45b6-837b-d81643078e8f None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:52.379982 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0168f70-b684-45b6-837b-d81643078e8f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:52.380520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0168f70-b684-45b6-837b-d81643078e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:52.438879 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-a0168f70-b684-45b6-837b-d81643078e8f None None] MFA Rules not processed for user `b762813126324c60b5bbbd7f201f4705`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:52.441411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-a0168f70-b684-45b6-837b-d81643078e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:52.572693 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 608/1197] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:52 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:52.593698 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:52.596290 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:52.625272 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:52.714946 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dfc03-dba4-40de-a285-1401cb8dad77 admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:52.719627 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbb8bab39c68414b8db430d75072f892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:52.720493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:52.721109 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:52.721546 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:52.806609 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:52.808411 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:52.837022 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 590/1198] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:18:52 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:18:52.985053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c5dff-b370-4922-9da1-04e442ab5ef3 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:52.985053 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c5dff-b370-4922-9da1-04e442ab5ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:52.985339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96c5dff-b370-4922-9da1-04e442ab5ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:53.035745 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-f96c5dff-b370-4922-9da1-04e442ab5ef3 None None] MFA Rules not processed for user `9a7d815f87ec42fa8238fff4d4de4270`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:18:53.037648 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-f96c5dff-b370-4922-9da1-04e442ab5ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:18:53.165138 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:18:53.199525 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 609/1199] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:18:52 2022] POST /identity/v3/auth/tokens => generated 2885 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:18:53.216131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:18:53.229082 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae6ab19-e087-406f-9143-3aac1340a7c1 service glance] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:18:53.236864 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24703123-5ac7-40d3-b0fb-4462bb53d317 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbb8bab39c68414b8db430d75072f892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:18:53.237825 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703123-5ac7-40d3-b0fb-4462bb53d317 service glance] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:18:53.239099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703123-5ac7-40d3-b0fb-4462bb53d317 service glance] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:18:53.239099 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24703123-5ac7-40d3-b0fb-4462bb53d317 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:18:53.327209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703123-5ac7-40d3-b0fb-4462bb53d317 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:18:53.329407 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24703123-5ac7-40d3-b0fb-4462bb53d317 service glance] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:18:53.339293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 591/1200] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:18:53 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:02.500902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1553-65be-48ca-89b6-b4ae3076bc6a None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:02.501519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1553-65be-48ca-89b6-b4ae3076bc6a None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:02.501519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1553-65be-48ca-89b6-b4ae3076bc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:02.522586 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-44ba1553-65be-48ca-89b6-b4ae3076bc6a None None] MFA Rules not processed for user `a26525fd24a04143bc0642259e281157`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:02.523902 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-44ba1553-65be-48ca-89b6-b4ae3076bc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:02.531555 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 610/1201] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:19:02 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:02.834875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d085f-cb79-430d-b2a0-bd50f47d78a5 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:02.835471 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d085f-cb79-430d-b2a0-bd50f47d78a5 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:02.835568 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d085f-cb79-430d-b2a0-bd50f47d78a5 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:02.838328 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 592/1202] 10.222.0.112 () {54 vars in 967 bytes} [Mon Jul 25 19:19:02 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:02.844669 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb096c-9db9-42f8-ae03-54f09750643f None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:02.844810 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb096c-9db9-42f8-ae03-54f09750643f None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:02.845057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfb096c-9db9-42f8-ae03-54f09750643f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:02.881144 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-bcfb096c-9db9-42f8-ae03-54f09750643f None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:02.882620 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-bcfb096c-9db9-42f8-ae03-54f09750643f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:02.962319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 611/1203] 10.222.0.112 () {58 vars in 1064 bytes} [Mon Jul 25 19:19:02 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:02.971646 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bf5a-5e7b-4687-a09f-feb92785f520 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:02.972425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bf5a-5e7b-4687-a09f-feb92785f520 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:02.973454 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bf5a-5e7b-4687-a09f-feb92785f520 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:02.976202 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 593/1204] 10.222.0.112 () {54 vars in 917 bytes} [Mon Jul 25 19:19:02 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:02.983549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c518e7-facf-4d99-bc11-aaf0a364fc06 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:02.984430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c518e7-facf-4d99-bc11-aaf0a364fc06 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:02.984611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c518e7-facf-4d99-bc11-aaf0a364fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:03.007319 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-69c518e7-facf-4d99-bc11-aaf0a364fc06 None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:03.008573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-69c518e7-facf-4d99-bc11-aaf0a364fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:03.018720 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 612/1205] 10.222.0.112 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:02 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:03.031337 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bf5a-5e7b-4687-a09f-feb92785f520 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:03.033386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-4997bf5a-5e7b-4687-a09f-feb92785f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:03.052453 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4997bf5a-5e7b-4687-a09f-feb92785f520 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:03.056999 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d895b44-90c9-4582-9006-1d4e0812681b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbb8bab39c68414b8db430d75072f892', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:03.057698 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895b44-90c9-4582-9006-1d4e0812681b service glance] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:03.057976 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895b44-90c9-4582-9006-1d4e0812681b service glance] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:03.058256 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d895b44-90c9-4582-9006-1d4e0812681b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:03.071092 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d895b44-90c9-4582-9006-1d4e0812681b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:03.073077 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d895b44-90c9-4582-9006-1d4e0812681b service glance] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:03.091285 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 594/1206] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:03 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:03.485965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6dbc-1429-4afe-864d-d3c695ee93c2 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:03.486262 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6dbc-1429-4afe-864d-d3c695ee93c2 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:03.486530 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db6dbc-1429-4afe-864d-d3c695ee93c2 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:03.488372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 613/1207] 10.222.0.112 () {54 vars in 917 bytes} [Mon Jul 25 19:19:03 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:03.495790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d92fd-5c14-4be6-a2f3-0ce92accee31 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:03.495790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d92fd-5c14-4be6-a2f3-0ce92accee31 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:03.496051 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d92fd-5c14-4be6-a2f3-0ce92accee31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:03.526790 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-bc0d92fd-5c14-4be6-a2f3-0ce92accee31 None None] MFA Rules not processed for user `6577ca8406124b4b9573937f8eea489d`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:03.528051 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-bc0d92fd-5c14-4be6-a2f3-0ce92accee31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:03.577309 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=100 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:03.594262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 595/1208] 10.222.0.112 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:03 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:03.607287 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6dbc-1429-4afe-864d-d3c695ee93c2 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:03.640268 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db6dbc-1429-4afe-864d-d3c695ee93c2 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:03.645138 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d7c58b-699a-4e6b-8802-11dee35d0757 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:03.646014 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c58b-699a-4e6b-8802-11dee35d0757 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:03.646573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c58b-699a-4e6b-8802-11dee35d0757 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:03.646913 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d7c58b-699a-4e6b-8802-11dee35d0757 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:03.664651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7c58b-699a-4e6b-8802-11dee35d0757 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:03.666245 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d7c58b-699a-4e6b-8802-11dee35d0757 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:03.676655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 614/1209] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:03 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:04.206189 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386c19-26b1-4860-9e12-8f4484b73806 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.206985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386c19-26b1-4860-9e12-8f4484b73806 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.206985 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75386c19-26b1-4860-9e12-8f4484b73806 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.209135 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 596/1210] 10.222.0.112 () {54 vars in 967 bytes} [Mon Jul 25 19:19:04 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:19:04.214952 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d73dc-1b14-4d1e-bed7-7ec86efe3f19 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.215474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d73dc-1b14-4d1e-bed7-7ec86efe3f19 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.215913 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355d73dc-1b14-4d1e-bed7-7ec86efe3f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.248771 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-355d73dc-1b14-4d1e-bed7-7ec86efe3f19 None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:04.249993 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-355d73dc-1b14-4d1e-bed7-7ec86efe3f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:04.255480 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b755-49ef-426a-9977-98b74bdb5b64 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.256429 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b755-49ef-426a-9977-98b74bdb5b64 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.257120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b755-49ef-426a-9977-98b74bdb5b64 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.260120 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 597/1211] 10.222.0.112 () {54 vars in 966 bytes} [Mon Jul 25 19:19:04 2022] GET /identity => generated 271 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:04.263115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 615/1212] 10.222.0.112 () {58 vars in 1064 bytes} [Mon Jul 25 19:19:04 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:04.269068 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b6af-d91d-447f-a900-75b2626c6f95 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.269743 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b6af-d91d-447f-a900-75b2626c6f95 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.270300 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c1b6af-d91d-447f-a900-75b2626c6f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.273369 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a19e5-18f5-4c96-ab57-422656d69092 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.274112 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a19e5-18f5-4c96-ab57-422656d69092 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.275235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a19e5-18f5-4c96-ab57-422656d69092 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.279214 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 616/1213] 10.222.0.112 () {54 vars in 917 bytes} [Mon Jul 25 19:19:04 2022] GET /identity => generated 271 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:04.285617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82db02-be05-46fa-b427-955bd648478e None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.286788 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82db02-be05-46fa-b427-955bd648478e None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.287627 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f82db02-be05-46fa-b427-955bd648478e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.333761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-3f82db02-be05-46fa-b427-955bd648478e None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:04.334995 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-3f82db02-be05-46fa-b427-955bd648478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:04.357920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 617/1214] 10.222.0.112 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:04 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:04.358918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82db02-be05-46fa-b427-955bd648478e None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:04.367671 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-f9c1b6af-d91d-447f-a900-75b2626c6f95 None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:04.369401 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f82db02-be05-46fa-b427-955bd648478e None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:04.369827 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-f9c1b6af-d91d-447f-a900-75b2626c6f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:04.379317 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:04.380011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.380290 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.380569 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.397025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:04.399291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:04.417038 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 618/1215] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:04 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:04.466350 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 598/1216] 10.222.0.112 () {58 vars in 1063 bytes} [Mon Jul 25 19:19:04 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:04.474249 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:04.496864 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4bd9f2-ca5f-494d-b498-b40ed5643dd4 service neutron] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:04.506853 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:04.507994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:04.508516 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:04.509231 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:04.512235 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:04.532381 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:04.535854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:04.557952 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 619/1217] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:04 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:14.454005 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=37 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:14.547130 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=69 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:18.238845 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a043483-e05b-4c4a-8101-dbe825cf9a24 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:18.239484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a043483-e05b-4c4a-8101-dbe825cf9a24 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:18.239484 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a043483-e05b-4c4a-8101-dbe825cf9a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:18.260871 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-9a043483-e05b-4c4a-8101-dbe825cf9a24 None None] MFA Rules not processed for user `6577ca8406124b4b9573937f8eea489d`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:18.262314 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-9a043483-e05b-4c4a-8101-dbe825cf9a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:18.270115 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 599/1218] 10.222.0.121 () {58 vars in 1020 bytes} [Mon Jul 25 19:19:18 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:18.283748 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:18.295584 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c031143-0272-4e26-b7df-d74de06cd652 service placement] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:18.299785 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd00fe-f80f-4687-ac6e-cf77b63b7856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:18.300451 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00fe-f80f-4687-ac6e-cf77b63b7856 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:18.300736 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00fe-f80f-4687-ac6e-cf77b63b7856 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:18.301166 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd00fe-f80f-4687-ac6e-cf77b63b7856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:18.310222 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd00fe-f80f-4687-ac6e-cf77b63b7856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:18.313061 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd00fe-f80f-4687-ac6e-cf77b63b7856 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:18.326564 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 620/1219] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:18 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:19.384239 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3fde7-096b-43b0-ab07-18feb69e1511 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:19.385276 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3fde7-096b-43b0-ab07-18feb69e1511 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:19.385778 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3fde7-096b-43b0-ab07-18feb69e1511 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:19.388160 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 600/1220] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:19:19 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:19:19.454796 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e017e-7d8a-48c8-a1e9-ae8f2071e1d7 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:19.455565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e017e-7d8a-48c8-a1e9-ae8f2071e1d7 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:19.455565 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e017e-7d8a-48c8-a1e9-ae8f2071e1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:19.481620 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-740e017e-7d8a-48c8-a1e9-ae8f2071e1d7 None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:19.483263 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-740e017e-7d8a-48c8-a1e9-ae8f2071e1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:19.497892 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 621/1221] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:19 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 25 19:19:19.523045 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3fde7-096b-43b0-ab07-18feb69e1511 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:19.542427 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3fde7-096b-43b0-ab07-18feb69e1511 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:19.554030 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa572d1f-3a7c-4670-aa0f-79be7347f547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:19.555058 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572d1f-3a7c-4670-aa0f-79be7347f547 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:19.555744 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572d1f-3a7c-4670-aa0f-79be7347f547 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:19.556378 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa572d1f-3a7c-4670-aa0f-79be7347f547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:19.570524 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa572d1f-3a7c-4670-aa0f-79be7347f547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:19.572364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa572d1f-3a7c-4670-aa0f-79be7347f547 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:19.588869 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 601/1222] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:19 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:26.867159 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c5ab5-a62c-46ac-bad4-cf78d4ebcbbb None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.868011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c5ab5-a62c-46ac-bad4-cf78d4ebcbbb None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.868011 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9c5ab5-a62c-46ac-bad4-cf78d4ebcbbb None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.869391 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 622/1223] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:19:26 2022] GET /identity => generated 271 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:26.880219 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.880926 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.881071 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.906418 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:26.909073 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:26.929199 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 602/1224] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:26 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:26.948372 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c5ab5-a62c-46ac-bad4-cf78d4ebcbbb None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:26.968495 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9c5ab5-a62c-46ac-bad4-cf78d4ebcbbb None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:26.979079 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a78e23-cfb9-4042-bd67-41700165c8c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:26.980343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a78e23-cfb9-4042-bd67-41700165c8c2 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:26.980761 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a78e23-cfb9-4042-bd67-41700165c8c2 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:26.981252 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a78e23-cfb9-4042-bd67-41700165c8c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:26.994189 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a78e23-cfb9-4042-bd67-41700165c8c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:26.996894 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a78e23-cfb9-4042-bd67-41700165c8c2 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:27.016257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 623/1225] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:26 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:36.897499 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=12 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:37.009452 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=15 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:40.333949 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:40.344166 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b8ca9-74d0-4b4b-a949-f01f328a5722 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:40.349569 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2501fde-84c7-4613-8ce2-679df0ddbebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:40.350942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2501fde-84c7-4613-8ce2-679df0ddbebb service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:40.351433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2501fde-84c7-4613-8ce2-679df0ddbebb service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:40.351835 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2501fde-84c7-4613-8ce2-679df0ddbebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:40.363635 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2501fde-84c7-4613-8ce2-679df0ddbebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:40.365186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2501fde-84c7-4613-8ce2-679df0ddbebb service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:40.375618 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 603/1226] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:40 2022] GET /identity/v3/auth/tokens => generated 2885 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:42.475792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb386b7-b5a6-43ee-88f2-5da2e86e7f71 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.476754 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb386b7-b5a6-43ee-88f2-5da2e86e7f71 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.477213 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb386b7-b5a6-43ee-88f2-5da2e86e7f71 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.479473 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 624/1227] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:19:42 2022] GET /identity => generated 271 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:19:42.485354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905818b5-c680-4918-b675-90ec9f46dfc6 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.486389 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905818b5-c680-4918-b675-90ec9f46dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.486932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905818b5-c680-4918-b675-90ec9f46dfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.516802 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-905818b5-c680-4918-b675-90ec9f46dfc6 None None] MFA Rules not processed for user `8186eb68ef564b31909d3e7495c3f544`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:42.518466 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-905818b5-c680-4918-b675-90ec9f46dfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:42.528787 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 604/1228] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:19:42 2022] POST /identity/v3/auth/tokens => generated 2861 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:42.543469 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb386b7-b5a6-43ee-88f2-5da2e86e7f71 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:42.559380 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb386b7-b5a6-43ee-88f2-5da2e86e7f71 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:42.565270 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51c831-b98c-42f5-b3eb-45646ad1dc05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:42.566491 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c831-b98c-42f5-b3eb-45646ad1dc05 service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:42.567160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c831-b98c-42f5-b3eb-45646ad1dc05 service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:42.567691 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51c831-b98c-42f5-b3eb-45646ad1dc05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:42.585905 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c831-b98c-42f5-b3eb-45646ad1dc05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:42.588192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51c831-b98c-42f5-b3eb-45646ad1dc05 service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:42.604291 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 625/1229] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:42 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:19:52.508910 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=9 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:52.598572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=6 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:19:58.433299 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.433873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.433873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.456121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:58.457338 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:58.465992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 605/1230] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:19:58 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:58.810696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022c0a-9f7f-4222-b914-2372f3ffe32b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.810696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022c0a-9f7f-4222-b914-2372f3ffe32b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.810696 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022c0a-9f7f-4222-b914-2372f3ffe32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.833320 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-e8022c0a-9f7f-4222-b914-2372f3ffe32b None None] MFA Rules not processed for user `6577ca8406124b4b9573937f8eea489d`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:19:58.834586 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-e8022c0a-9f7f-4222-b914-2372f3ffe32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:19:58.845470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 626/1231] 10.222.0.112 () {58 vars in 1014 bytes} [Mon Jul 25 19:19:58 2022] POST /identity/v3/auth/tokens => generated 2679 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:19:58.859992 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:19:58.873000 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e0d5f-75f7-4670-b1e1-8ada300ad559 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:19:58.877781 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465a43e-0fc8-4a9c-92e7-c5006cd1fe49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:19:58.878469 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a43e-0fc8-4a9c-92e7-c5006cd1fe49 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:19:58.886173 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a43e-0fc8-4a9c-92e7-c5006cd1fe49 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:19:58.886173 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465a43e-0fc8-4a9c-92e7-c5006cd1fe49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:19:58.889512 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465a43e-0fc8-4a9c-92e7-c5006cd1fe49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:19:58.889636 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6465a43e-0fc8-4a9c-92e7-c5006cd1fe49 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:19:58.900349 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 606/1232] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:19:58 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:20:08.826951 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:08.896343 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=9 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:24.812010 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184dc2-dbb3-4131-a09f-29bee29c1ffe None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:24.812519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184dc2-dbb3-4131-a09f-29bee29c1ffe None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:24.812519 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb184dc2-dbb3-4131-a09f-29bee29c1ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:24.837636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-fb184dc2-dbb3-4131-a09f-29bee29c1ffe None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:24.839094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-fb184dc2-dbb3-4131-a09f-29bee29c1ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:24.849610 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 627/1233] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:20:24 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:34.829829 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:20:38.921749 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:20:38.922215 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:20:38.922313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:20:38.942445 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:20:38.943668 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:20:38.952181 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 607/1234] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:20:38 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:20:48.937088 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:41.916527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:41.917339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:41.917339 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:41.943623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:21:41.944929 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:21:41.953479 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 628/1235] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:21:41 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:21:51.937687 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=3 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:21:56.395377 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:21:56.416037 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8454c27-5ef1-42d3-b642-3207b3df1430 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:21:56.420152 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:21:56.420719 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:21:56.420997 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:21:56.421267 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:21:56.431357 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:21:56.432899 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:21:56.444228 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 608/1236] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:21:56 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:22:06.438187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=10 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:22:43.747572 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:22:43.773069 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eccc78-0a45-407a-b28a-7286e319ffbc None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:22:43.778667 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:22:43.779325 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:22:43.779651 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:22:43.780052 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:22:43.790178 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:22:43.792015 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:22:43.803031 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 629/1237] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:22:43 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:22:53.798306 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=10 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:15.243224 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:15.268078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9ef30-b9ef-4eed-9f5a-6b9480b7bb78 service neutron] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:15.273658 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:15.274313 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:15.274733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:15.275077 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:15.284223 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:15.286277 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:15.296672 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 609/1238] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:15 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:15.490005 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:15.503332 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df302455-c842-4fda-991c-c0893054fa42 service placement] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:15.507824 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b014e3-6c32-47fd-aaa0-ec4f51a6007d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:15.508482 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b014e3-6c32-47fd-aaa0-ec4f51a6007d service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:15.508767 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b014e3-6c32-47fd-aaa0-ec4f51a6007d service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:15.509044 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b014e3-6c32-47fd-aaa0-ec4f51a6007d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:15.520057 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b014e3-6c32-47fd-aaa0-ec4f51a6007d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:15.521492 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b014e3-6c32-47fd-aaa0-ec4f51a6007d service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:15.532611 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 630/1239] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:15 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:16.726129 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:16.742540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f48c4-96e4-414c-a551-887f1481510c service nova] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:16.747942 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:16.748800 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:16.749159 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:16.749482 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:16.768887 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:16.770376 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:16.781481 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 610/1240] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:16 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:20.475528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:20.476006 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:20.476094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:20.498021 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:24:20.499241 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:20.506678 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 631/1241] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:24:20 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:22.366981 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:22.380146 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72926016-11ed-403d-9b65-3c3a4df71636 service neutron] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:22.386868 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:22.387576 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:22.387865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:22.388143 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:22.398584 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:22.400522 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:22.411439 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 611/1242] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:22 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:24.300924 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:24.312422 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6854c82-a4a1-409c-b4c8-5c0154a2b590 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:24.316478 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:24.317236 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:24.317622 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:24.318063 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:24.326720 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:24.328334 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:24.338670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 632/1243] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:24 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:24:25.079761 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:25.094803 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d112663-1e46-403d-9f5a-2897456e749a service placement] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:25.101881 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:25.102566 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:25.102845 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:25.103121 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:25.113216 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:25.114856 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:25.126447 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 612/1244] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:25 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:32.344859 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:32.361871 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45f3530-674c-423d-923c-d135f8740a08 service neutron] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:32.369497 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:32.370670 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:32.371071 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:32.371566 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:32.384113 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:32.385854 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:32.398545 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 633/1245] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:32 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:24:35.121299 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=28 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:40.085823 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:40.097339 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae7bf7-e3dd-4960-b858-08586fad1316 service nova] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:40.104895 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8f4f32-d5e1-4818-9510-c1e6828e77d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:40.105935 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4f32-d5e1-4818-9510-c1e6828e77d5 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:40.106405 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4f32-d5e1-4818-9510-c1e6828e77d5 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:40.106882 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8f4f32-d5e1-4818-9510-c1e6828e77d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:40.121107 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4f32-d5e1-4818-9510-c1e6828e77d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:40.123896 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8f4f32-d5e1-4818-9510-c1e6828e77d5 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:40.140028 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 613/1246] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:40 2022] GET /identity/v3/auth/tokens => generated 2818 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:42.393411 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=21 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:42.546394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:42.566327 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06269b2a-b8ec-4bd0-95d1-1c5ec1ac7f4e service nova] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:42.575431 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:42.576220 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:42.576501 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:42.576781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:42.589855 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:42.592306 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:42.612617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 634/1247] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:42 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:24:50.133281 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=6 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:52.603695 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=6 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:24:58.679452 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:58.680094 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:58.680312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:58.701495 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] MFA Rules not processed for user `a26525fd24a04143bc0642259e281157`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:24:58.702741 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:24:58.711002 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 614/1248] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:24:58 2022] POST /identity/v3/auth/tokens => generated 2818 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:24:59.038655 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:24:59.048753 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed80141-77bb-4a0d-aba4-11b548e8ef4c service nova] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:24:59.053714 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15091106-24b5-4364-9a3e-c3d223a73fe5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:24:59.054365 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091106-24b5-4364-9a3e-c3d223a73fe5 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:24:59.054646 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091106-24b5-4364-9a3e-c3d223a73fe5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:24:59.054922 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15091106-24b5-4364-9a3e-c3d223a73fe5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:24:59.064636 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15091106-24b5-4364-9a3e-c3d223a73fe5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:24:59.066107 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15091106-24b5-4364-9a3e-c3d223a73fe5 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:24:59.078868 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 635/1249] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:24:59 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 25 19:25:08.697106 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=3 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:09.072567 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=6 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:25:28.649512 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:25:28.659834 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d430f44-c255-4eda-b8c9-fdc600c67919 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:25:28.663796 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:25:28.664464 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:25:28.664774 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:25:28.665049 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:25:28.675271 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:25:28.676849 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:25:28.689142 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 615/1250] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:25:28 2022] GET /identity/v3/auth/tokens => generated 2885 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:25:38.682606 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=6 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:43.110118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:43.110118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:43.110118 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:43.139421 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] MFA Rules not processed for user `77de8e36db3e42caa1d9a498bc67385f`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:26:43.140626 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:26:43.165394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 636/1251] 10.222.0.112 () {58 vars in 963 bytes} [Mon Jul 25 19:26:43 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:26:43.487553 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:43.508580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c11aad-7beb-43d6-bc5c-0d740f0bbf3b service neutron] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:43.512925 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:43.513580 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:43.513865 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:43.514140 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:43.522520 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:43.524009 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:43.532599 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 616/1252] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:43 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:26:53.163248 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=15 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:53.528767 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=11 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:26:58.920792 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:26:58.936470 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8229e16d-628d-46ae-80c0-7327e5263b92 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:26:58.942991 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:26:58.943925 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:26:58.944280 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:26:58.944649 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:26:58.963498 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:26:58.965000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:26:58.975619 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 637/1253] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:26:58 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:27:08.970679 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=9 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:27:50.689980 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:27:50.691626 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:50.722562 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36397076-7a48-47ba-b8d8-daf5a99bc263 service neutron] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:27:50.728952 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:27:50.729621 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:27:50.729917 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:27:50.730197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:27:50.732194 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:27:50.744498 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:27:50.746110 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015fa3c-b5f9-48af-9fd1-1d6b76ce2aa0 service placement] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:27:50.758513 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 617/1254] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:27:50 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:00.751932 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=10 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:19.615458 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:19.618250 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:19.646191 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7690187f-8f34-4bea-b49c-b6674ece9864 service neutron] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:19.650774 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebcb0e0-1380-4448-80be-030b8355b6f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:19.651468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb0e0-1380-4448-80be-030b8355b6f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:19.651468 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb0e0-1380-4448-80be-030b8355b6f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:19.652527 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebcb0e0-1380-4448-80be-030b8355b6f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:19.757397 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb0e0-1380-4448-80be-030b8355b6f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:19.758939 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebcb0e0-1380-4448-80be-030b8355b6f4 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:19.780192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 638/1255] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:19 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:23.837175 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9b54-4eff-41e7-bac2-472ff823a147 None None] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:23.838704 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9b54-4eff-41e7-bac2-472ff823a147 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:23.839047 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af9b54-4eff-41e7-bac2-472ff823a147 None None] PATH_INFO: `/` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:23.841312 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 618/1256] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:28:23 2022] GET /identity => generated 271 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 235 bytes (2 switches on core 0) Jul 25 19:28:23.871750 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336ad9-cd7e-4700-a49e-cc1a8019b77b None None] REQUEST_METHOD: `POST` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:23.872300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336ad9-cd7e-4700-a49e-cc1a8019b77b None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:23.872300 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3336ad9-cd7e-4700-a49e-cc1a8019b77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:23.995346 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.auth.core [None req-c3336ad9-cd7e-4700-a49e-cc1a8019b77b None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87475) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:23.997927 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-c3336ad9-cd7e-4700-a49e-cc1a8019b77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:24.023134 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 639/1257] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:28:23 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:24.075733 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9b54-4eff-41e7-bac2-472ff823a147 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:24.099024 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af9b54-4eff-41e7-bac2-472ff823a147 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:24.105643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9eaaf-c7e6-4cbf-b134-3687c389ab02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:24.106430 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9eaaf-c7e6-4cbf-b134-3687c389ab02 service placement] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:24.106977 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9eaaf-c7e6-4cbf-b134-3687c389ab02 service placement] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:24.107304 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9eaaf-c7e6-4cbf-b134-3687c389ab02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:24.120651 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9eaaf-c7e6-4cbf-b134-3687c389ab02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:24.122583 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9eaaf-c7e6-4cbf-b134-3687c389ab02 service placement] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:24.138310 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 619/1258] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:24 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:27.961192 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8aea-c27a-4f9a-86b5-3bc494085e56 None None] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:27.961935 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8aea-c27a-4f9a-86b5-3bc494085e56 None None] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:27.962965 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8aea-c27a-4f9a-86b5-3bc494085e56 None None] PATH_INFO: `/` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:27.973628 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 640/1259] 10.222.0.112 () {54 vars in 926 bytes} [Mon Jul 25 19:28:27 2022] GET /identity => generated 271 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 235 bytes (1 switches on core 0) Jul 25 19:28:28.240591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] REQUEST_METHOD: `POST` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:28.241204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:28.241204 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:28.265982 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.auth.core [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] MFA Rules not processed for user `50fdd25fd4ca4e6ca5f31046c4dde96c`. Rule list: `[]` (Enabled: `True`). {{(pid=87474) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 25 19:28:28.267681 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:28.278359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f8aea-c27a-4f9a-86b5-3bc494085e56 None None] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:28.283027 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 620/1260] 10.222.0.112 () {58 vars in 1023 bytes} [Mon Jul 25 19:28:28 2022] POST /identity/v3/auth/tokens => generated 2866 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 25 19:28:28.299457 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:28.300314 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f8aea-c27a-4f9a-86b5-3bc494085e56 None None] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:28.305703 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:28.306705 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:28.306981 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:28.307260 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] PATH_INFO: `/v3/users/a26525fd24a04143bc0642259e281157` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:28.308575 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26525fd24a04143bc0642259e281157)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:28.309706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: WARNING py.warnings [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:28:28.309706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: warnings.warn(msg) Jul 25 19:28:28.309706 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: Jul 25 19:28:28.310918 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:28.311055 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af244a-20c8-491f-85a6-9b9bfe49c9e5 None None] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:28.316254 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:28.316929 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:28.317209 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:28.317487 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:28.327149 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:28.328809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:28.339782 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 621/1261] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:28:28 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:28:28.392414 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26525fd24a04143bc0642259e281157'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.393975 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26525fd24a04143bc0642259e281157'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.395408 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26525fd24a04143bc0642259e281157'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.419945 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26525fd24a04143bc0642259e281157'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.430963 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26525fd24a04143bc0642259e281157'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.441507 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:28.448448 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 641/1262] 10.222.0.112 () {58 vars in 1229 bytes} [Mon Jul 25 19:28:28 2022] DELETE /identity/v3/users/a26525fd24a04143bc0642259e281157 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:28.647436 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:28.659888 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c81b72-84de-41fa-b75d-7456fb01c4a1 service placement] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:28.737927 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:28.738850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:28.739131 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:28.739410 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] PATH_INFO: `/v3/projects/6d21ffad06ac4d36b7899443db0f92c2` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:28.740612 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d21ffad06ac4d36b7899443db0f92c2)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:28.741643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: WARNING py.warnings [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 25 19:28:28.741643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: warnings.warn(msg) Jul 25 19:28:28.741643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: Jul 25 19:28:28.743125 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:28.802763 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d21ffad06ac4d36b7899443db0f92c2', 'request_id': 'req-bed7038c-f8c0-4fca-8974-2b962829e01f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.809518 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d21ffad06ac4d36b7899443db0f92c2', 'request_id': 'req-bed7038c-f8c0-4fca-8974-2b962829e01f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.819485 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d21ffad06ac4d36b7899443db0f92c2', 'request_id': 'req-bed7038c-f8c0-4fca-8974-2b962829e01f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.853593 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] The token cache is being invalidate because project 6d21ffad06ac4d36b7899443db0f92c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:28:28.853873 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.854720 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:28.856486 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 622/1263] 10.222.0.112 () {58 vars in 1238 bytes} [Mon Jul 25 19:28:28 2022] DELETE /identity/v3/projects/6d21ffad06ac4d36b7899443db0f92c2 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:28.860970 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:28.862623 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:28.877573 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb475-0e04-45d0-a62c-b45d43eb8f54 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:28.948100 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:28.948994 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:28.949271 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:28.949549 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] PATH_INFO: `/v3/users/9a7d815f87ec42fa8238fff4d4de4270` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:28.951168 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a7d815f87ec42fa8238fff4d4de4270)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:28.953311 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:29.014058 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a7d815f87ec42fa8238fff4d4de4270'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.015139 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a7d815f87ec42fa8238fff4d4de4270'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.015781 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a7d815f87ec42fa8238fff4d4de4270'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.029173 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a7d815f87ec42fa8238fff4d4de4270'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.038394 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a7d815f87ec42fa8238fff4d4de4270'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.054003 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 642/1264] 10.222.0.112 () {58 vars in 1229 bytes} [Mon Jul 25 19:28:28 2022] DELETE /identity/v3/users/9a7d815f87ec42fa8238fff4d4de4270 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:29.263638 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:28:29.266051 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:28:29.279491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7038c-f8c0-4fca-8974-2b962829e01f admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:28:29.328643 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:29.345060 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:28:29.346053 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:28:29.346340 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:28:29.346633 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] PATH_INFO: `/v3/projects/1f74f8e1b57746cbbceefb93859cfcbb` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:28:29.348087 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f74f8e1b57746cbbceefb93859cfcbb)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:28:29.350451 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:28:29.402153 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f74f8e1b57746cbbceefb93859cfcbb', 'request_id': 'req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.408425 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f74f8e1b57746cbbceefb93859cfcbb', 'request_id': 'req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.418515 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f74f8e1b57746cbbceefb93859cfcbb', 'request_id': 'req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.433765 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] The token cache is being invalidate because project 1f74f8e1b57746cbbceefb93859cfcbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87474) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:28:29.434069 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.435044 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:28:29.436748 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 623/1265] 10.222.0.112 () {58 vars in 1238 bytes} [Mon Jul 25 19:28:29 2022] DELETE /identity/v3/projects/1f74f8e1b57746cbbceefb93859cfcbb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:28:39.050477 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:28:39.430444 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=30,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:15.167676 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:15.169185 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:15.389375 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b44c9-9b68-4b0b-b33e-a6af0c8e024a admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:15.452730 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54ea2fbc34f9488e8a431acf95db792f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:15.453635 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:15.453920 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:15.454202 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:15.457528 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:15.549226 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:15.550680 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:15.570377 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 643/1266] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:15 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:25.567581 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=90 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:42.260516 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:42.262188 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:42.362186 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b9a08-1c6c-42f3-b493-710ffd0ca2bc admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:42.369852 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:42.370603 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:42.370809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:42.371116 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:42.379768 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:42.396354 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:42.398164 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:42.409074 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 624/1267] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:42 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:42.453115 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:42.455310 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:42.527942 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ea9d8b-2ffd-495c-b7af-56514470b6f2 service cinder] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:42.531521 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:42.532160 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:42.532439 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:42.532710 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:42.534514 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:42.547359 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:42.548802 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:42.559964 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 644/1268] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:42 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:42.626187 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:42.627694 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:42.639386 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca3a92-72dc-4a6c-86f0-7668c813a747 service nova] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:42.643703 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:42.644359 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:42.644641 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:42.644916 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:42.647433 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:42.658058 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:42.659578 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:42.670117 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 625/1269] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:42 2022] GET /identity/v3/auth/tokens => generated 2679 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:43.768430 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:43.779790 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25b22a-83dc-4922-8f19-d320e49ed8c6 service neutron] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:43.785008 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:43.785916 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:43.786297 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:43.786701 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:43.789070 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:43.805803 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:43.807318 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:43.819354 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 645/1270] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:43 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:44.049632 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:44.051491 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:44.068875 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8916729-730f-4e67-a908-b88a3c3d320e service neutron] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:44.074521 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8186eb68ef564b31909d3e7495c3f544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:44.075127 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:44.075475 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:44.075729 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:44.077753 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:44.090329 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:44.091994 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:44.102828 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 626/1271] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:44 2022] GET /identity/v3/auth/tokens => generated 2861 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:48.123232 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:48.132158 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bc7561-0963-4bc3-a54a-24eafd395607 service neutron] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:48.136617 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6577ca8406124b4b9573937f8eea489d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:48.137094 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] REQUEST_METHOD: `GET` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:48.137474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:48.137474 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:48.139908 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:48.214715 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:48.216242 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:48.227747 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 646/1272] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:29:48 2022] GET /identity/v3/auth/tokens => generated 2797 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:29:54.098364 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=49 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:54.990003 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:54.991656 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:55.006907 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013106ee-b420-4b96-bb18-bb5cd14b86db service nova] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:55.011899 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:55.012850 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:55.013197 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:55.013542 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] PATH_INFO: `/v3/users/77de8e36db3e42caa1d9a498bc67385f` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:55.014813 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77de8e36db3e42caa1d9a498bc67385f)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:55.016830 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:55.078978 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77de8e36db3e42caa1d9a498bc67385f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.090063 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77de8e36db3e42caa1d9a498bc67385f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.097262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77de8e36db3e42caa1d9a498bc67385f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.110809 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77de8e36db3e42caa1d9a498bc67385f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.111727 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77de8e36db3e42caa1d9a498bc67385f'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.118550 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 627/1273] 10.222.0.112 () {58 vars in 1229 bytes} [Mon Jul 25 19:29:54 2022] DELETE /identity/v3/users/77de8e36db3e42caa1d9a498bc67385f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:29:55.324520 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:55.337466 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8518c5e1-aad1-4bea-956d-44f66af7ce7d service neutron] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:55.405998 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:55.407331 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:55.407874 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:55.408288 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] PATH_INFO: `/v3/projects/0c5725669659486fb28cc4e53049a867` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:55.410041 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c5725669659486fb28cc4e53049a867)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:55.412459 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:55.449444 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:55.472000 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c5725669659486fb28cc4e53049a867', 'request_id': 'req-9032b9c1-dfc3-4f1f-b0db-c499aa157928'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.478534 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c5725669659486fb28cc4e53049a867', 'request_id': 'req-9032b9c1-dfc3-4f1f-b0db-c499aa157928'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.487025 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c5725669659486fb28cc4e53049a867', 'request_id': 'req-9032b9c1-dfc3-4f1f-b0db-c499aa157928'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.499417 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] The token cache is being invalidate because project 0c5725669659486fb28cc4e53049a867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:29:55.499729 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.500483 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.502188 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 647/1274] 10.222.0.112 () {58 vars in 1238 bytes} [Mon Jul 25 19:29:55 2022] DELETE /identity/v3/projects/0c5725669659486fb28cc4e53049a867 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:29:55.506398 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:55.508005 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:55.522493 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89306fbb-5e7d-428d-87dd-429de96bac6c admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:55.594607 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:55.595530 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:55.595807 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:55.596078 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] PATH_INFO: `/v3/users/b762813126324c60b5bbbd7f201f4705` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:55.611060 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b762813126324c60b5bbbd7f201f4705)` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:55.613083 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:55.665963 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b762813126324c60b5bbbd7f201f4705'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.676382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b762813126324c60b5bbbd7f201f4705'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.683931 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b762813126324c60b5bbbd7f201f4705'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.685092 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:29:55.700279 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b762813126324c60b5bbbd7f201f4705'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.700934 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.notifications [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b762813126324c60b5bbbd7f201f4705'} {{(pid=87474) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:55.706766 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 628/1275] 10.222.0.112 () {58 vars in 1229 bytes} [Mon Jul 25 19:29:55 2022] DELETE /identity/v3/users/b762813126324c60b5bbbd7f201f4705 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:29:55.894777 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Authenticating user token {{(pid=87475) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:29:55.896306 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.fernet_utils [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87475) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:29:55.910308 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032b9c1-dfc3-4f1f-b0db-c499aa157928 admin admin] Validating token access rules against request {{(pid=87475) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:29:55.972526 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7930508aa7a648b2940c5e4fcfe5b1be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58b503a03d964e16b18f95569d131e22', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87475) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:29:55.973343 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:29:55.973837 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:29:55.974345 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] PATH_INFO: `/v3/projects/a9ca12af7da043a5aff3d5fa9b689978` {{(pid=87475) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:29:55.988557 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ca12af7da043a5aff3d5fa9b689978)` {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:29:55.991076 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] RBAC: Authorization granted {{(pid=87475) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:29:56.044243 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ca12af7da043a5aff3d5fa9b689978', 'request_id': 'req-9871352b-b2d8-46d8-b71e-28a35cee9b26'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:56.061533 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ca12af7da043a5aff3d5fa9b689978', 'request_id': 'req-9871352b-b2d8-46d8-b71e-28a35cee9b26'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:56.078758 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ca12af7da043a5aff3d5fa9b689978', 'request_id': 'req-9871352b-b2d8-46d8-b71e-28a35cee9b26'} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:56.092990 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] The token cache is being invalidate because project a9ca12af7da043a5aff3d5fa9b689978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87475) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 25 19:29:56.093257 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:56.093949 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG keystone.notifications [None req-9871352b-b2d8-46d8-b71e-28a35cee9b26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87475) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 25 19:29:56.095550 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: [pid: 87475|app: 0|req: 648/1276] 10.222.0.112 () {58 vars in 1238 bytes} [Mon Jul 25 19:29:55 2022] DELETE /identity/v3/projects/a9ca12af7da043a5aff3d5fa9b689978 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 25 19:30:05.703382 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=7,keystone:DELETE=2 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:30:06.089656 dv-osbrick-786732-10-ceph devstack@keystone.service[87475]: DEBUG dbcounter [-] [87475] Writing DB stats keystone:DELETE=13,keystone:SELECT=69,keystone:INSERT=2 {{(pid=87475) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 25 19:32:55.639847 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Authenticating user token {{(pid=87474) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 25 19:32:55.641689 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:55.761289 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a62d6-c5c9-46b7-9117-0d53dc57b740 admin admin] Validating token access rules against request {{(pid=87474) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 25 19:32:55.840293 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50fdd25fd4ca4e6ca5f31046c4dde96c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9ba0954eaec24e5693174204533745a9', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87474) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 25 19:32:55.840975 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] REQUEST_METHOD: `GET` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 25 19:32:55.841262 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] SCRIPT_NAME: `/identity` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 25 19:32:55.841541 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87474) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 25 19:32:55.843591 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.fernet_utils [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87474) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 25 19:32:55.855893 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 25 19:32:55.857500 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf09fa-59b6-493e-9600-b2756bb0f8cb service placement] RBAC: Authorization granted {{(pid=87474) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 25 19:32:55.868540 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: [pid: 87474|app: 0|req: 629/1277] 10.222.0.112 () {60 vars in 1370 bytes} [Mon Jul 25 19:32:55 2022] GET /identity/v3/auth/tokens => generated 2866 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 25 19:33:05.863984 dv-osbrick-786732-10-ceph devstack@keystone.service[87474]: DEBUG dbcounter [-] [87474] Writing DB stats keystone:SELECT=67 {{(pid=87474) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}